Sep 06 22:36:59 devstack cinder-volume[76522]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 22:36:59 devstack cinder-volume[76522]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 22:36:59 devstack cinder-volume[76522]: we strongly recommend against using it for new projects. Sep 06 22:36:59 devstack cinder-volume[76522]: If you are already using Eventlet, we recommend migrating to a different Sep 06 22:36:59 devstack cinder-volume[76522]: framework. For more detail see Sep 06 22:36:59 devstack cinder-volume[76522]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 22:36:59 devstack cinder-volume[76522]: import eventlet # noqa Sep 06 22:37:02 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:37:02 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:37:02 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:37:03 devstack cinder-volume[76522]: INFO dbcounter [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Registered counter for database cinder Sep 06 22:37:03 devstack cinder-volume[76522]: DEBUG oslo_db.sqlalchemy.engines [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG dbcounter [-] [76522] Writer thread running {{(pid=76522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.rpc [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.rpc [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_db.sqlalchemy.engines [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.volume.manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Determined volume DB was empty at startup. Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG cinder.volume.manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76522) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.volume.manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 22:37:04 devstack cinder-volume[76522]: WARNING stevedore.named [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 22:37:04 devstack cinder-volume[76522]: WARNING castellan.key_manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:37:04 devstack cinder-volume[76522]: WARNING cinder.keymgr.conf_key_mgr [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG cinder.volume.drivers.lvm [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76522) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_concurrency.processutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_concurrency.processutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] CMD "cinder-rtstool verify" returned: 0 in 0.442s {{(pid=76522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_db.sqlalchemy.engines [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.rpc [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.rpc [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 06 22:37:04 devstack cinder-volume[76522]: WARNING stevedore.named [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 22:37:04 devstack cinder-volume[76522]: WARNING castellan.key_manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:37:04 devstack cinder-volume[76522]: INFO cinder.volume.manager [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_db.sqlalchemy.engines [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:37:04 devstack cinder-volume[76522]: INFO oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Starting 1 workers Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Started child 76715 {{(pid=76522) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Full set of CONF: {{(pid=76522) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] ******************************************************************************** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Configuration options gathered from: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] ================================================================================ {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] allow_availability_zone_fallback = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] allow_compression_on_image_upload = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] allowed_direct_url_schemes = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] api_rate_limit = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] auth_strategy = keystone {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] az_cache_duration = 3600 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_availability_zone = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76715]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_host = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_stats_polling_interval = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backup_api_class = cinder.backup.api.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backup_name_template = backup-%s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backup_use_same_host = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backup_use_temp_snapshot = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] chap_password = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] chap_username = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_internal_tenant_project_id = 8df3d2df2561427ca221ea635409ec82 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_internal_tenant_user_id = 805dc7b6c89d4cd791fcdbeaa4a5ba9f {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cloned_volume_same_az = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cluster = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] compression_format = gzip {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] compute_api_class = cinder.compute.nova.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] config_dir = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] config_source = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:04 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] control_exchange = openstack {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] debug = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] default_availability_zone = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] default_group_type = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] default_volume_type = lvmdriver-1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] disk_geometry = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_client_cert = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_client_cert_key = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_data_namespace = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_ssl_cert_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_ssl_cert_verify = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] driver_use_ssl = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] enable_force_upload = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] enable_new_services = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] enable_unsupported_driver = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] enforce_multipath_for_image_xfer = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] filter_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_api_insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_api_ssl_compression = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_ca_certificates_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_catalog_info = image:glance:publicURL {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_num_retries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance_request_timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] goodness_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] graceful_shutdown_timeout = 5 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] group_api_class = cinder.group.api.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] host = devstack {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_compress_on_upload = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_conversion_address_space_limit = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_conversion_cpu_limit = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_conversion_disable = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_upload_use_cinder_backend = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_upload_use_internal_tenant = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_volume_cache_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_volume_cache_max_count = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] image_volume_cache_max_size_gb = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] init_host_max_objects_retrieval = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] instance_format = [instance: %(uuid)s] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iscsi_target_flags = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iscsi_write_cache = on {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iser_helper = tgtadm {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iser_ip_address = 192.168.122.248 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iser_port = 3260 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_color = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_config_append = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_dir = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_options = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_rotate_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_rotate_interval_type = days {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] log_rotation_type = none {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76715]: INFO cinder.volume.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] max_age = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] max_logfile_count = 30 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] max_logfile_size_mb = 200 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] max_over_subscription_ratio = 20.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] message_reap_interval = 86400 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] message_ttl = 2592000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] migration_create_volume_timeout_secs = 300 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] monkey_patch = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] monkey_patch_modules = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] my_ip = 192.168.122.248 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] no_snapshot_gb_quota = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] num_iser_scan_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] num_shell_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] num_volume_device_scan_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] nvmeof_conn_info_version = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] nvmet_ns_id = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] nvmet_port_id = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_max_limit = 1000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_ext_list = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_listen_port = 8776 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_use_ssl = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] osapi_volume_workers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] per_volume_size_limit = -1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] periodic_fuzzy_delay = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] periodic_interval = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] public_endpoint = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] publish_errors = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_backup_gigabytes = 1000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_backups = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_gigabytes = 1000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_groups = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_snapshots = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] quota_volumes = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] rate_limit_burst = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] rate_limit_except_level = CRITICAL {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] rate_limit_interval = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] reinit_driver_count = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] replication_device = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] report_discard_supported = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] report_interval = 120 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] reservation_clean_interval = 86400 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] reservation_expire = 86400 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] reserved_image_namespaces = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] reserved_percentage = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] rpc_response_timeout = 120 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] run_external_periodic_tasks = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] scst_target_driver = iscsi {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] scst_target_iqn_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_down_time = 720 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] shell_completion = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] snapshot_name_template = snapshot-%s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] snapshot_same_host = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] split_loggers = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] state_path = /opt/stack/data/cinder {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] storage_availability_zone = nova {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] storage_protocol = iSCSI {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] syslog_log_facility = LOG_USER {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_helper = lioadm {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_ip_address = 192.168.122.248 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_port = 3260 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_protocol = iscsi {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] target_secondary_ip_addresses = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] trace_flags = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] transport_url = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] until_refresh = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_chap_auth = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_default_quota_class = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_journal = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_json = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_multipath_for_image_xfer = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_stderr = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] use_syslog = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] verify_glance_signatures = enabled {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_api_class = cinder.volume.api.API {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_backend_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_clear = zero {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_clear_ionice = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_clear_size = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_copy_bps_limit = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_dd_blocksize = 1M {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_name_template = volume-%s {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_service_inithost_offload = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volume_usage_audit_period = month {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] zoning_mode = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_concurrency.disable_process_locking = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.auth_section = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.auth_type = password {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.auth_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.cache = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.include_service_catalog = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.interface = public {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_password = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcache_username = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.region_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.service_type = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.backend = dogpile.cache.null {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.backend_argument = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.backend_expiration_time = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.config_prefix = cache.oslo {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.debug_cache_backend = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.enable_retry_client = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.enable_socket_keepalive = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.expiration_time = 600 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.hashclient_retry_attempts = 2 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_dead_retry = 300 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_pool_maxsize = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_sasl_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.password = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.proxies = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.redis_db = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.redis_server = localhost:6379 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.retry_attempts = 2 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.retry_delay = 0.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.socket_keepalive_count = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.socket_keepalive_idle = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.socket_keepalive_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.socket_timeout = 1.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.tls_allowed_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.tls_cafile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.tls_certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.tls_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.tls_keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cache.username = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] coordination.backend_url = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.asyncio_connection = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.asyncio_slave_connection = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.backend = sqlalchemy {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.connection = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.connection_debug = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.connection_parameters = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.connection_recycle_time = 3600 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.connection_trace = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.db_inc_retry_interval = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.db_max_retries = 20 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.db_max_retry_interval = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.db_retry_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.max_overflow = 50 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.max_pool_size = 5 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.max_retries = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.mysql_wsrep_sync_wait = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.pool_timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.retry_interval = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.slave_connection = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.sqlite_synchronous = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.synchronous_reader = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] database.use_db_reconnect = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_tracing.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.connection_string = messaging:// {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.es_doc_type = notification {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.es_scroll_size = 10000 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.es_scroll_time = 2m {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.filter_error_trace = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.hmac_keys = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.sentinel_service_name = mymaster {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.socket_timeout = 0.1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.trace_requests = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler.trace_sqlalchemy = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler_jaeger.process_tags = {} {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler_jaeger.service_name_prefix = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] profiler_otlp.service_name_prefix = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.enforce_new_defaults = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.policy_default_rule = default {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.policy_file = policy.yaml {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.group = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.helper_command = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] privsep_osbrick.user = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.group = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.helper_command = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] cinder_sys_admin.user = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.auth_section = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.auth_type = password {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.cafile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.collect_timing = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.send_service_user_token = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.split_loggers = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.tls_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] service_user.tls_min_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.auth_section = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.auth_type = password {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.collect_timing = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.region_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.split_loggers = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.tls_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] glance.tls_min_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.backend_availability_zone = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.chap_password = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.chap_username = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.disk_geometry = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_client_cert = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_client_cert_key = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_data_namespace = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.driver_use_ssl = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.extra_capabilities = {} {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.filter_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.goodness_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iscsi_target_flags = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iscsi_write_cache = on {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iser_helper = tgtadm {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iser_port = 3260 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.lvm_share_target = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.lvm_type = auto {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.num_shell_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.replication_device = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.report_discard_supported = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.reserved_percentage = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_helper = tgtadm {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_port = 3260 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_protocol = iscsi {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.trace_flags = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.unique_fqdn_network = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.use_chap_auth = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_backend_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_clear = zero {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_clear_ionice = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_clear_size = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_reports.file_event_handler = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_reports.log_dir = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.backend_host = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.chap_password = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.chap_username = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.disk_geometry = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_client_cert = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.extra_capabilities = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.filter_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.goodness_function = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iser_helper = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iser_ip_address = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iser_port = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.lvm_share_target = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.lvm_type = auto {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.num_shell_tries = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.replication_device = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.report_discard_supported = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.reserved_percentage = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.scst_target_driver = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.storage_protocol = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_helper = lioadm {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_ip_address = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_port = 3260 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.trace_flags = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.use_chap_auth = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_clear = zero {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_clear_size = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] lvmdriver-1.volumes_dir = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_notifications.driver = [] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_notifications.retry = -1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] key_manager.fixed_key = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.barbican_api_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.barbican_endpoint = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.barbican_endpoint_type = public {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.barbican_region_name = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.cafile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.collect_timing = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.number_of_retries = 60 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.retry_delay = 1 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.send_service_user_token = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.split_loggers = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.tls_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.tls_min_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.verify_ssl = True {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican.verify_ssl_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.auth_section = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.auth_type = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.cafile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.certfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.collect_timing = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.insecure = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.keyfile = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.split_loggers = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.timeout = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.tls_ciphers = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] barbican_service_user.tls_min_version = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.approle_role_id = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.approle_secret_id = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.auth_method = approle {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.auth_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.kv_mountpoint = secret {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.kv_path = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.kv_version = 2 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.namespace = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.root_token_id = **** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.ssl_ca_crt_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.timeout = 60.0 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.token_file = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.token_role = None {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.use_ssl = False {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:37:05 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] ******************************************************************************** {{(pid=76522) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 22:37:05 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.378s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:05 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:05 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.326s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:37:05 devstack cinder-volume[76715]: INFO cinder.brick.local_dev.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:05 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:05 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:05 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:06 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG cinder.brick.local_dev.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76715) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:06 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:06 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:06 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:06 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:06 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:06 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:07 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:07 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 06 22:37:07 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:07 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.292s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:07 devstack sudo[77335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:07 devstack sudo[77335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:07 devstack sudo[77335]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:07 devstack sudo[77338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:07 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:07 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:07 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:07 devstack sudo[77422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:07 devstack sudo[77422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:08 devstack sudo[77422]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:08 devstack sudo[77425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:08 devstack sudo[77425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:08 devstack sudo[77425]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:08 devstack sudo[77494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:08 devstack sudo[77494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:08 devstack sudo[77494]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:08 devstack cinder-volume[76715]: INFO cinder.volume.drivers.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:08 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:08 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:08 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:09 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:09 devstack sudo[77528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:09 devstack sudo[77528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:09 devstack sudo[77528]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:09 devstack sudo[77531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:09 devstack sudo[77531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:09 devstack sudo[77531]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:09 devstack sudo[77534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:09 devstack sudo[77534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:09 devstack sudo[77534]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:09 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:09 devstack sudo[77537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:09 devstack sudo[77537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:10 devstack sudo[77537]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:10 devstack cinder-volume[76715]: INFO cinder.volume.driver [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Driver hasn't implemented _init_vendor_properties() Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG cinder.volume.driver [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76715) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_db.sqlalchemy.engines [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76715) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writer thread running {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG cinder.db.api [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Building query based on filter {{(pid=76715) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG cinder.image.image_utils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76715) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 22:37:10 devstack cinder-volume[76715]: INFO cinder.keymgr.migration [None req-06d0c4d9-5d5a-4a74-8e60-9cb11434ed61 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:10 devstack sudo[77540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:10 devstack sudo[77540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:10 devstack sudo[77540]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:10 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:10 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:10 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:10 devstack sudo[77548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:10 devstack sudo[77548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:10 devstack sudo[77548]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:10 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:11 devstack sudo[77552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:11 devstack sudo[77552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:11 devstack sudo[77552]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG cinder.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Notifying Schedulers of capabilities ... {{(pid=76715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:37:11 devstack cinder-volume[76715]: INFO cinder.volume.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Driver initialization completed successfully. Sep 06 22:37:11 devstack cinder-volume[76715]: INFO cinder.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Initiating service 2 cleanup Sep 06 22:37:11 devstack cinder-volume[76715]: INFO cinder.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Service 2 cleanup completed. Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG cinder.service [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Creating RPC server for service cinder-volume {{(pid=76715) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG cinder.service [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76715) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 22:37:11 devstack cinder-volume[76715]: INFO cinder.volume.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:11 devstack sudo[77555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:37:11 devstack sudo[77555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:11 devstack sudo[77555]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:11 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:11 devstack sudo[77558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:11 devstack sudo[77558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:12 devstack sudo[77558]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:12 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:12 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:12 devstack sudo[77563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:37:12 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:12 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:12 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:12 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:37:12 devstack sudo[77569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:37:12 devstack sudo[77569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:37:12 devstack sudo[77569]: pam_unix(sudo:session): session closed for user root Sep 06 22:37:12 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:37:12 devstack cinder-volume[76715]: INFO cinder.volume.manager [None req-d37cdf72-e5ac-4fdd-acb9-5aac449fb8ba None None] Driver post RPC initialization completed successfully. Sep 06 22:37:14 devstack cinder-volume[76522]: DEBUG dbcounter [-] [76522] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:37:18 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager._thread_info {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:37:18 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread count: 6 {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:37:18 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread info: [<_MainThread(MainThread, started 126804319780992)>, , , , , ] {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:37:21 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:SELECT=2 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:37:22 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:38:18 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:38:18 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:38:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:38:18 devstack sudo[79621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:38:18 devstack sudo[79621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:38:18 devstack sudo[79621]: pam_unix(sudo:session): session closed for user root Sep 06 22:38:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:38:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:38:18 devstack sudo[79624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:38:18 devstack sudo[79624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:38:19 devstack sudo[79624]: pam_unix(sudo:session): session closed for user root Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:38:19 devstack sudo[79627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:38:19 devstack sudo[79627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:38:19 devstack sudo[79627]: pam_unix(sudo:session): session closed for user root Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:38:19 devstack sudo[79639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:38:19 devstack sudo[79639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:38:19 devstack sudo[79639]: pam_unix(sudo:session): session closed for user root Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG cinder.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Notifying Schedulers of capabilities ... {{(pid=76715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager._thread_info {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread count: 6 {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:38:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread info: [<_MainThread(MainThread, started 126804319780992)>, , , , , ] {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:39:18 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:39:18 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:39:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:39:18 devstack sudo[82979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:39:18 devstack sudo[82979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:39:18 devstack sudo[82979]: pam_unix(sudo:session): session closed for user root Sep 06 22:39:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:39:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:39:18 devstack sudo[82982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:39:18 devstack sudo[82982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:39:19 devstack sudo[82982]: pam_unix(sudo:session): session closed for user root Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:39:19 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:39:19 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:39:19 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:39:19 devstack sudo[82996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:39:19 devstack sudo[82996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:39:19 devstack sudo[82996]: pam_unix(sudo:session): session closed for user root Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:39:19 devstack cinder-volume[76715]: DEBUG cinder.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Notifying Schedulers of capabilities ... {{(pid=76715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:39:22 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:SELECT=1 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:39:22 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:UPDATE=1 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:40:18 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:40:18 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:40:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:40:18 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:40:18 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:40:18 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Sep 06 22:40:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:40:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:40:18 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:40:18 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:40:19 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:40:19 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:40:19 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:40:19 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:40:19 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:40:19 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:40:19 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG cinder.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Notifying Schedulers of capabilities ... {{(pid=76715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager._thread_info {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread count: 6 {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:40:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread info: [<_MainThread(MainThread, started 126804319780992)>, , , , , ] {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:41:18 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:41:18 devstack cinder-volume[76715]: DEBUG cinder.volume.drivers.lvm [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Updating volume stats {{(pid=76715) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 22:41:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:18 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 22:41:18 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:18 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:18 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:18 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:41:18 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:19 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:19 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 22:41:19 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:19 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:19 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 22:41:19 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:19 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_concurrency.processutils [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG cinder.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Notifying Schedulers of capabilities ... {{(pid=76715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG oslo_service.periodic_task [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] Running periodic task VolumeManager._thread_info {{(pid=76715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread count: 6 {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:41:19 devstack cinder-volume[76715]: DEBUG cinder.volume.manager [None req-c78de12b-37a9-4b68-a11c-380b2db22051 None None] thread info: [<_MainThread(MainThread, started 126804319780992)>, , , , , ] {{(pid=76715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:41:22 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:SELECT=1 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:41:22 devstack cinder-volume[76715]: DEBUG dbcounter [-] [76715] Writing DB stats cinder:UPDATE=1 {{(pid=76715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:41:33 devstack cinder-volume[76522]: INFO oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Caught SIGTERM, stopping children Sep 06 22:41:33 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Acquiring lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:33 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Acquired lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:33 devstack cinder-volume[76522]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Releasing lock "singleton_lock" {{(pid=76522) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:33 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Stop services. {{(pid=76522) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 22:41:33 devstack cinder-volume[76522]: DEBUG oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Killing children. {{(pid=76522) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 22:41:33 devstack cinder-volume[76522]: INFO oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Waiting on 1 children to exit Sep 06 22:41:36 devstack cinder-volume[76715]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Acquiring lock "singleton_lock" {{(pid=76715) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:36 devstack cinder-volume[76715]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Acquired lock "singleton_lock" {{(pid=76715) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:36 devstack cinder-volume[76715]: DEBUG oslo_concurrency.lockutils [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Releasing lock "singleton_lock" {{(pid=76715) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:36 devstack cinder-volume[76715]: WARNING amqp [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 22:41:36 devstack cinder-volume[76715]: WARNING amqp [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 22:41:36 devstack cinder-volume[76522]: INFO oslo_service.backend._eventlet.service [None req-29c4db67-aad8-4144-aaad-60be4eeced39 None None] Child 76715 exited with status 0 Sep 06 22:41:36 devstack cinder-volume[86719]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 22:41:36 devstack cinder-volume[86719]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 22:41:36 devstack cinder-volume[86719]: we strongly recommend against using it for new projects. Sep 06 22:41:36 devstack cinder-volume[86719]: If you are already using Eventlet, we recommend migrating to a different Sep 06 22:41:36 devstack cinder-volume[86719]: framework. For more detail see Sep 06 22:41:36 devstack cinder-volume[86719]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 22:41:36 devstack cinder-volume[86719]: import eventlet # noqa Sep 06 22:41:38 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:38 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:38 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:39 devstack cinder-volume[86719]: INFO dbcounter [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Registered counter for database cinder Sep 06 22:41:39 devstack cinder-volume[86719]: DEBUG oslo_db.sqlalchemy.engines [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:39 devstack cinder-volume[86719]: DEBUG dbcounter [-] [86719] Writer thread running {{(pid=86719) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:41:39 devstack cinder-volume[86719]: INFO cinder.rpc [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 22:41:39 devstack cinder-volume[86719]: INFO cinder.rpc [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_db.sqlalchemy.engines [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:40 devstack cinder-volume[86719]: INFO cinder.volume.manager [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Determined volume DB was empty at startup. Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG cinder.volume.manager [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86719) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 22:41:40 devstack cinder-volume[86719]: INFO cinder.volume.manager [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 22:41:40 devstack cinder-volume[86719]: WARNING stevedore.named [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 22:41:40 devstack cinder-volume[86719]: WARNING castellan.key_manager [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:41:40 devstack cinder-volume[86719]: WARNING cinder.keymgr.conf_key_mgr [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:41:40 devstack cinder-volume[86719]: INFO cinder.volume.manager [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_db.sqlalchemy.engines [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:40 devstack cinder-volume[86719]: INFO oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Starting 1 workers Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Started child 86934 {{(pid=86719) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Full set of CONF: {{(pid=86719) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] ******************************************************************************** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Configuration options gathered from: {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] ================================================================================ {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] allow_availability_zone_fallback = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] allow_compression_on_image_upload = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] allowed_direct_url_schemes = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] api_rate_limit = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] auth_strategy = keystone {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_availability_zone = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_host = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_stats_polling_interval = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backup_api_class = cinder.backup.api.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backup_name_template = backup-%s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backup_use_same_host = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backup_use_temp_snapshot = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86934]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] chap_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] chap_username = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_internal_tenant_project_id = 8df3d2df2561427ca221ea635409ec82 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_internal_tenant_user_id = 805dc7b6c89d4cd791fcdbeaa4a5ba9f {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cluster = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] compression_format = gzip {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] compute_api_class = cinder.compute.nova.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] config_dir = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] config_source = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] control_exchange = openstack {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] debug = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] default_availability_zone = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] default_group_type = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] default_volume_type = QuobyteHD {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] disk_geometry = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_client_cert = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_client_cert_key = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_data_namespace = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_ssl_cert_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_ssl_cert_verify = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] driver_use_ssl = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] enable_new_services = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] enable_unsupported_driver = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] enabled_backends = ['QuobyteHD'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] enforce_multipath_for_image_xfer = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] filter_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_api_insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_api_ssl_compression = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_ca_certificates_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_catalog_info = image:glance:publicURL {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_num_retries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance_request_timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] goodness_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] graceful_shutdown_timeout = 5 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] group_api_class = cinder.group.api.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] host = devstack {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_compress_on_upload = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_conversion_address_space_limit = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_conversion_cpu_limit = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_conversion_disable = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_upload_use_cinder_backend = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_upload_use_internal_tenant = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_volume_cache_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_volume_cache_max_count = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] image_volume_cache_max_size_gb = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] init_host_max_objects_retrieval = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] instance_format = [instance: %(uuid)s] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iscsi_target_flags = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iscsi_write_cache = on {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iser_helper = tgtadm {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iser_ip_address = 192.168.122.248 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iser_port = 3260 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_color = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_config_append = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_dir = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_options = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_rotate_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_rotate_interval_type = days {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] log_rotation_type = none {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] max_age = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] max_logfile_count = 30 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] max_logfile_size_mb = 200 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] max_over_subscription_ratio = 20.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] message_reap_interval = 86400 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] message_ttl = 2592000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] migration_create_volume_timeout_secs = 300 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] monkey_patch = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] monkey_patch_modules = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] my_ip = 192.168.122.248 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] no_snapshot_gb_quota = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] num_iser_scan_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] num_shell_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] num_volume_device_scan_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] nvmeof_conn_info_version = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] nvmet_ns_id = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] nvmet_port_id = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_max_limit = 1000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_ext_list = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_listen_port = 8776 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_use_ssl = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] osapi_volume_workers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] per_volume_size_limit = -1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] periodic_fuzzy_delay = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] periodic_interval = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] public_endpoint = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] publish_errors = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_backup_gigabytes = 1000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_backups = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_gigabytes = 1000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_groups = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_snapshots = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] quota_volumes = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] rate_limit_burst = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] rate_limit_except_level = CRITICAL {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] rate_limit_interval = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] reinit_driver_count = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] replication_device = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] report_discard_supported = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] report_interval = 120 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] reservation_clean_interval = 86400 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] reservation_expire = 86400 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] reserved_image_namespaces = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] reserved_percentage = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] rpc_response_timeout = 120 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] run_external_periodic_tasks = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] scst_target_driver = iscsi {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] scst_target_iqn_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_down_time = 720 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] shell_completion = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] snapshot_name_template = snapshot-%s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] split_loggers = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] state_path = /opt/stack/data/cinder {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] storage_availability_zone = nova {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] storage_protocol = iSCSI {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] syslog_log_facility = LOG_USER {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_helper = lioadm {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_ip_address = 192.168.122.248 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_port = 3260 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_protocol = iscsi {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] target_secondary_ip_addresses = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] trace_flags = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] transport_url = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] until_refresh = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_chap_auth = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_default_quota_class = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_journal = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_json = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_multipath_for_image_xfer = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_stderr = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] use_syslog = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] verify_glance_signatures = enabled {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_api_class = cinder.volume.api.API {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_backend_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_clear = zero {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_clear_ionice = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_clear_size = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_copy_bps_limit = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_dd_blocksize = 1M {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_name_template = volume-%s {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_service_inithost_offload = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.remotefs [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86934) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volume_usage_audit_period = month {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] zoning_mode = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_concurrency.disable_process_locking = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.auth_section = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.auth_type = password {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.auth_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.cache = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.include_service_catalog = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.interface = public {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcache_username = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.region_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.service_type = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.backend = dogpile.cache.null {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.backend_argument = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.backend_expiration_time = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.config_prefix = cache.oslo {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.debug_cache_backend = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.enable_retry_client = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.enable_socket_keepalive = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.expiration_time = 600 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.hashclient_retry_attempts = 2 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_dead_retry = 300 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_pool_maxsize = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_sasl_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.proxies = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.redis_db = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.redis_server = localhost:6379 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.retry_attempts = 2 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.retry_delay = 0.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.socket_keepalive_count = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.socket_keepalive_idle = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.socket_keepalive_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.socket_timeout = 1.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.tls_allowed_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.tls_cafile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.tls_certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.tls_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.tls_keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cache.username = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] coordination.backend_url = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.asyncio_connection = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.asyncio_slave_connection = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.backend = sqlalchemy {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.connection = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.connection_debug = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.connection_parameters = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.connection_recycle_time = 3600 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.connection_trace = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.db_inc_retry_interval = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.db_max_retries = 20 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.db_max_retry_interval = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.db_retry_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.max_overflow = 50 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.max_pool_size = 5 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.max_retries = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.mysql_wsrep_sync_wait = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.pool_timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.retry_interval = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.slave_connection = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.sqlite_synchronous = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.synchronous_reader = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] database.use_db_reconnect = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_tracing.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.connection_string = messaging:// {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.es_doc_type = notification {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.es_scroll_size = 10000 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.es_scroll_time = 2m {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.filter_error_trace = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.hmac_keys = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.sentinel_service_name = mymaster {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.socket_timeout = 0.1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.trace_requests = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler.trace_sqlalchemy = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler_jaeger.process_tags = {} {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler_jaeger.service_name_prefix = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] profiler_otlp.service_name_prefix = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.enforce_new_defaults = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.policy_default_rule = default {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.policy_file = policy.yaml {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.group = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.helper_command = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] privsep_osbrick.user = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.group = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.helper_command = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] cinder_sys_admin.user = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.auth_section = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.auth_type = password {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.cafile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.collect_timing = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.send_service_user_token = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.split_loggers = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.tls_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] service_user.tls_min_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.auth_section = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.auth_type = password {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.collect_timing = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.region_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.split_loggers = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.tls_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] glance.tls_min_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.backend_availability_zone = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.chap_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.chap_username = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.disk_geometry = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_client_cert = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_client_cert_key = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_data_namespace = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.driver_use_ssl = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.extra_capabilities = {} {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.filter_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.goodness_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iscsi_target_flags = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iscsi_write_cache = on {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iser_helper = tgtadm {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iser_port = 3260 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_host = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_login = admin {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_mount_options = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_private_key = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_share_path = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.num_shell_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.quobyte_volume_url = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.replication_device = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.report_discard_supported = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.reserved_percentage = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_helper = tgtadm {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_port = 3260 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_protocol = iscsi {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.trace_flags = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.unique_fqdn_network = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.use_chap_auth = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_backend_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_clear = zero {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_clear_ionice = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_clear_size = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_reports.file_event_handler = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_reports.log_dir = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.backend_availability_zone = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.backend_host = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.chap_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.chap_username = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.chiscsi_conf = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.disk_geometry = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_client_cert = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_data_namespace = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.driver_use_ssl = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.extra_capabilities = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.filter_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.goodness_function = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86934) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iser_helper = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iser_ip_address = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86934]: WARNING cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iser_port = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86934]: WARNING cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.iser_target_prefix = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_host = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_login = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_mount_options = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Running cmd (subprocess): mount.quobyte {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_password = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_private_key = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_share_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_ssh_port = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.num_shell_tries = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.nvmet_port_id = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.replication_device = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.report_discard_supported = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.reserved_percentage = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.scst_target_driver = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.storage_protocol = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_helper = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_ip_address = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_port = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_prefix = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_protocol = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.trace_flags = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.use_chap_auth = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_clear = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_clear_size = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] QuobyteHD.volumes_dir = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_notifications.driver = [] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_notifications.retry = -1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] key_manager.fixed_key = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.barbican_api_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.barbican_endpoint = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.barbican_endpoint_type = public {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.barbican_region_name = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.cafile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.collect_timing = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.number_of_retries = 60 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.retry_delay = 1 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.send_service_user_token = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.split_loggers = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.tls_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.tls_min_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.verify_ssl = True {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican.verify_ssl_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.auth_section = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.auth_type = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.cafile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.certfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.collect_timing = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.insecure = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.keyfile = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.split_loggers = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.timeout = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.tls_ciphers = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] barbican_service_user.tls_min_version = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.approle_role_id = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.approle_secret_id = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.auth_method = approle {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.auth_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.kv_mountpoint = secret {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.kv_path = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.kv_version = 2 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.namespace = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.root_token_id = **** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.ssl_ca_crt_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.timeout = 60.0 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.token_file = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.token_role = None {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.use_ssl = False {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:40 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] ******************************************************************************** {{(pid=86719) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 22:41:40 devstack quobyte-client[86939]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 22:41:40 devstack quobyte-client[86939]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:40 devstack cinder-volume[86934]: INFO cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 ... Sep 06 22:41:40 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 -c /etc/quobyte/client-cinder.cfg {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:40 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 -c /etc/quobyte/client-cinder.cfg Sep 06 22:41:40 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:41 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.372s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 succeeded Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.385s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:41 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:41 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:41 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.246s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.volume.driver [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Driver hasn't implemented _init_vendor_properties() Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.driver [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6511421203613, 'free_capacity_gb': 1773.6511421203613, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86934) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_db.sqlalchemy.engines [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG dbcounter [-] [86934] Writer thread running {{(pid=86934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.db.api [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Building query based on filter {{(pid=86934) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.image.image_utils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86934) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.keymgr.migration [None req-2e1e264a-e736-4d3d-b8d7-1f4d4726ebec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:41 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:41 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:41 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.228s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Notifying Schedulers of capabilities ... {{(pid=86934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Driver initialization completed successfully. Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Initiating service 3 cleanup Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Service 3 cleanup completed. Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.service [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Creating RPC server for service cinder-volume {{(pid=86934) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.service [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86934) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 22:41:41 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:41 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:41 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:41 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:42 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:42 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.245s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:42 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-9672b078-d326-4785-85f2-40a80a169a0a None None] Driver post RPC initialization completed successfully. Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:46 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:46 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:46 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.237s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:46 devstack cinder-volume[86934]: DEBUG cinder.manager [None req-76cb272c-1cff-4eaa-9257-fb1abb1b2a8d None None] Notifying Schedulers of capabilities ... {{(pid=86934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:41:47 devstack cinder-volume[86719]: INFO oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Caught SIGTERM, stopping children Sep 06 22:41:47 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Acquiring lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:47 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Acquired lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:47 devstack cinder-volume[86719]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Releasing lock "singleton_lock" {{(pid=86719) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:47 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Stop services. {{(pid=86719) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 22:41:47 devstack cinder-volume[86719]: DEBUG oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Killing children. {{(pid=86719) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 22:41:47 devstack cinder-volume[86719]: INFO oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Waiting on 1 children to exit Sep 06 22:41:50 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Acquiring lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:50 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Acquired lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:50 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Releasing lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:50 devstack cinder-volume[86934]: WARNING amqp [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 22:41:50 devstack cinder-volume[86934]: WARNING amqp [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 22:41:50 devstack cinder-volume[86719]: INFO oslo_service.backend._eventlet.service [None req-c7d71db2-05c4-4726-b09d-47a129d9b58d None None] Child 86934 exited with status 0 Sep 06 22:41:50 devstack cinder-volume[87221]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 22:41:50 devstack cinder-volume[87221]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 22:41:50 devstack cinder-volume[87221]: we strongly recommend against using it for new projects. Sep 06 22:41:50 devstack cinder-volume[87221]: If you are already using Eventlet, we recommend migrating to a different Sep 06 22:41:50 devstack cinder-volume[87221]: framework. For more detail see Sep 06 22:41:50 devstack cinder-volume[87221]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 22:41:50 devstack cinder-volume[87221]: import eventlet # noqa Sep 06 22:41:53 devstack cinder-volume[87221]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 22:41:53 devstack cinder-volume[87221]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 22:41:53 devstack cinder-volume[87221]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 22:41:54 devstack cinder-volume[87221]: INFO dbcounter [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Registered counter for database cinder Sep 06 22:41:54 devstack cinder-volume[87221]: DEBUG oslo_db.sqlalchemy.engines [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:54 devstack cinder-volume[87221]: DEBUG dbcounter [-] [87221] Writer thread running {{(pid=87221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:41:54 devstack cinder-volume[87221]: INFO cinder.rpc [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 22:41:54 devstack cinder-volume[87221]: INFO cinder.rpc [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_db.sqlalchemy.engines [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:55 devstack cinder-volume[87221]: INFO cinder.volume.manager [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Determined volume DB was empty at startup. Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG cinder.volume.manager [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87221) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 22:41:55 devstack cinder-volume[87221]: WARNING stevedore.named [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 22:41:55 devstack cinder-volume[87221]: WARNING castellan.key_manager [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:41:55 devstack cinder-volume[87221]: WARNING cinder.keymgr.conf_key_mgr [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 22:41:55 devstack cinder-volume[87221]: INFO cinder.volume.manager [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_db.sqlalchemy.engines [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:55 devstack cinder-volume[87221]: INFO oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Starting 1 workers Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Started child 87517 {{(pid=87221) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Full set of CONF: {{(pid=87221) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] ******************************************************************************** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] Configuration options gathered from: {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 22:41:55 devstack cinder-volume[87517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] ================================================================================ {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] allow_availability_zone_fallback = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] allow_compression_on_image_upload = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] allowed_direct_url_schemes = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] api_rate_limit = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] auth_strategy = keystone {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_availability_zone = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_host = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_stats_polling_interval = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backup_api_class = cinder.backup.api.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backup_name_template = backup-%s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backup_use_same_host = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backup_use_temp_snapshot = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] chap_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] chap_username = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_internal_tenant_project_id = 8df3d2df2561427ca221ea635409ec82 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_internal_tenant_user_id = 805dc7b6c89d4cd791fcdbeaa4a5ba9f {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cluster = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] compression_format = gzip {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] compute_api_class = cinder.compute.nova.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] config_dir = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] config_source = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] control_exchange = openstack {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] debug = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] default_availability_zone = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] default_group_type = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] default_volume_type = QuobyteHD {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] disk_geometry = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_client_cert = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_client_cert_key = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_data_namespace = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_ssl_cert_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_ssl_cert_verify = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] driver_use_ssl = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] enable_new_services = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] enable_unsupported_driver = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] enabled_backends = ['QuobyteHD'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] enforce_multipath_for_image_xfer = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] filter_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_api_insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_api_ssl_compression = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_ca_certificates_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_catalog_info = image:glance:publicURL {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_num_retries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance_request_timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] goodness_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] graceful_shutdown_timeout = 5 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] group_api_class = cinder.group.api.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] host = devstack {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_compress_on_upload = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_conversion_address_space_limit = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_conversion_cpu_limit = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_conversion_disable = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_upload_use_cinder_backend = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_upload_use_internal_tenant = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_volume_cache_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_volume_cache_max_count = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] image_volume_cache_max_size_gb = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] init_host_max_objects_retrieval = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] instance_format = [instance: %(uuid)s] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iscsi_target_flags = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iscsi_write_cache = on {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iser_helper = tgtadm {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iser_ip_address = 192.168.122.248 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iser_port = 3260 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_color = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_config_append = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_dir = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_options = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_rotate_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_rotate_interval_type = days {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] log_rotation_type = none {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] max_age = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] max_logfile_count = 30 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] max_logfile_size_mb = 200 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] max_over_subscription_ratio = 20.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] message_reap_interval = 86400 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] message_ttl = 2592000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] migration_create_volume_timeout_secs = 300 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87517) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] monkey_patch = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] monkey_patch_modules = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] my_ip = 192.168.122.248 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] no_snapshot_gb_quota = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] num_iser_scan_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] num_shell_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] num_volume_device_scan_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] nvmeof_conn_info_version = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] nvmet_ns_id = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] nvmet_port_id = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_max_limit = 1000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_ext_list = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_listen_port = 8776 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_use_ssl = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] osapi_volume_workers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] per_volume_size_limit = -1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] periodic_fuzzy_delay = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] periodic_interval = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] public_endpoint = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] publish_errors = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_backup_gigabytes = 1000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_backups = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_gigabytes = 1000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_groups = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_snapshots = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] quota_volumes = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] rate_limit_burst = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] rate_limit_except_level = CRITICAL {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] rate_limit_interval = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] reinit_driver_count = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] replication_device = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] report_discard_supported = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] report_interval = 120 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] reservation_clean_interval = 86400 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] reservation_expire = 86400 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] reserved_image_namespaces = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] reserved_percentage = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] rpc_response_timeout = 120 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] run_external_periodic_tasks = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] scst_target_driver = iscsi {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] scst_target_iqn_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_down_time = 720 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] shell_completion = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] snapshot_name_template = snapshot-%s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] split_loggers = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] state_path = /opt/stack/data/cinder {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] storage_availability_zone = nova {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] storage_protocol = iSCSI {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] syslog_log_facility = LOG_USER {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_helper = lioadm {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_ip_address = 192.168.122.248 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_port = 3260 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_protocol = iscsi {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] target_secondary_ip_addresses = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] trace_flags = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] transport_url = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] until_refresh = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_chap_auth = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_default_quota_class = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_journal = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_json = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_multipath_for_image_xfer = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_stderr = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] use_syslog = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] verify_glance_signatures = enabled {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_api_class = cinder.volume.api.API {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_backend_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_clear = zero {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_clear_ionice = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_clear_size = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_copy_bps_limit = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_dd_blocksize = 1M {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_name_template = volume-%s {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_service_inithost_offload = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volume_usage_audit_period = month {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] zoning_mode = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_concurrency.disable_process_locking = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.auth_section = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.auth_type = password {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.auth_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.cache = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.include_service_catalog = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.interface = public {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcache_username = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.region_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.service_type = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.backend = dogpile.cache.null {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.backend_argument = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.backend_expiration_time = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.config_prefix = cache.oslo {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.debug_cache_backend = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.enable_retry_client = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.enable_socket_keepalive = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.expiration_time = 600 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.hashclient_retry_attempts = 2 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_dead_retry = 300 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_pool_maxsize = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_sasl_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.proxies = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.redis_db = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.redis_server = localhost:6379 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.retry_attempts = 2 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.retry_delay = 0.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.socket_keepalive_count = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.socket_keepalive_idle = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.socket_keepalive_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.socket_timeout = 1.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.tls_allowed_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.tls_cafile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.tls_certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.tls_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.tls_keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cache.username = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] coordination.backend_url = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.asyncio_connection = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.asyncio_slave_connection = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.backend = sqlalchemy {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.connection = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.connection_debug = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.connection_parameters = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.connection_recycle_time = 3600 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.connection_trace = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.db_inc_retry_interval = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.db_max_retries = 20 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.db_max_retry_interval = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.db_retry_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.max_overflow = 50 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.max_pool_size = 5 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.max_retries = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.mysql_wsrep_sync_wait = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.pool_timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.retry_interval = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.slave_connection = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.sqlite_synchronous = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.synchronous_reader = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] database.use_db_reconnect = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_tracing.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.connection_string = messaging:// {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.es_doc_type = notification {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.es_scroll_size = 10000 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.es_scroll_time = 2m {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.filter_error_trace = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.hmac_keys = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.sentinel_service_name = mymaster {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.socket_timeout = 0.1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.trace_requests = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler.trace_sqlalchemy = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler_jaeger.process_tags = {} {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler_jaeger.service_name_prefix = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] profiler_otlp.service_name_prefix = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.enforce_new_defaults = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.policy_default_rule = default {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.policy_file = policy.yaml {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87517) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.group = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.helper_command = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] privsep_osbrick.user = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.group = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.helper_command = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] cinder_sys_admin.user = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.auth_section = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.auth_type = password {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.cafile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.collect_timing = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.send_service_user_token = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Running cmd (subprocess): mount.quobyte {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.split_loggers = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.tls_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] service_user.tls_min_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.auth_section = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.auth_type = password {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.collect_timing = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.region_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.split_loggers = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.tls_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] glance.tls_min_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.backend_availability_zone = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.chap_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.chap_username = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.disk_geometry = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_client_cert = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_client_cert_key = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_data_namespace = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.driver_use_ssl = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.extra_capabilities = {} {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.filter_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.goodness_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iscsi_target_flags = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iscsi_write_cache = on {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iser_helper = tgtadm {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iser_port = 3260 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_host = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_login = admin {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_mount_options = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_private_key = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_share_path = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.num_shell_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.quobyte_volume_url = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.replication_device = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.report_discard_supported = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.reserved_percentage = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_helper = tgtadm {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_port = 3260 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_protocol = iscsi {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.trace_flags = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.unique_fqdn_network = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.use_chap_auth = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_backend_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_clear = zero {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_clear_ionice = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_clear_size = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_reports.file_event_handler = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_reports.log_dir = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.backend_availability_zone = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.backend_host = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.chap_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.chap_username = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.chiscsi_conf = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.disk_geometry = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_client_cert = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack quobyte-client[87520]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 22:41:55 devstack quobyte-client[87520]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_data_namespace = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.driver_use_ssl = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.extra_capabilities = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.filter_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.goodness_function = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iser_helper = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iser_ip_address = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iser_port = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.iser_target_prefix = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_host = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_login = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_mount_options = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_password = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_private_key = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_share_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_ssh_port = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.num_shell_tries = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.nvmet_port_id = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.replication_device = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.report_discard_supported = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.reserved_percentage = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.scst_target_driver = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.storage_protocol = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_helper = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_ip_address = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_port = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_prefix = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_protocol = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.trace_flags = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.use_chap_auth = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_clear = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_clear_size = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] QuobyteHD.volumes_dir = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_notifications.driver = [] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_notifications.retry = -1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] key_manager.fixed_key = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.barbican_api_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.barbican_endpoint = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.barbican_endpoint_type = public {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.barbican_region_name = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.cafile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.collect_timing = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.number_of_retries = 60 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.retry_delay = 1 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.send_service_user_token = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.split_loggers = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.tls_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.tls_min_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.verify_ssl = True {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican.verify_ssl_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.auth_section = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.auth_type = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.cafile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.certfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.collect_timing = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.insecure = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.keyfile = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.split_loggers = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.timeout = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.tls_ciphers = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] barbican_service_user.tls_min_version = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.approle_role_id = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.approle_secret_id = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.auth_method = approle {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.auth_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.kv_mountpoint = secret {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.kv_path = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.kv_version = 2 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.namespace = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.root_token_id = **** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.ssl_ca_crt_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.timeout = 60.0 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.token_file = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.token_role = None {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.use_ssl = False {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 22:41:55 devstack cinder-volume[87221]: DEBUG oslo_service.backend._eventlet.service [None req-c62f86f3-34bf-4023-96fe-cda1ce128812 None None] ******************************************************************************** {{(pid=87221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 22:41:55 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:55 devstack cinder-volume[87517]: INFO cinder.volume.driver [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Driver hasn't implemented _init_vendor_properties() Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.driver [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6511421203613, 'free_capacity_gb': 1773.6511421203613, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_db.sqlalchemy.engines [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writer thread running {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.db.api [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Building query based on filter {{(pid=87517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.keymgr.migration [None req-30ebcad5-9cfd-465a-81dd-a15a32834536 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 22:41:56 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:56 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:56 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Driver initialization completed successfully. Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Initiating service 3 cleanup Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Service 3 cleanup completed. Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG cinder.service [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Creating RPC server for service cinder-volume {{(pid=87517) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG cinder.service [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87517) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:41:56 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:41:56 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:41:56 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Sep 06 22:41:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:41:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7de15658-6492-42c7-9f3e-e8fa2ea3a163 None None] Driver post RPC initialization completed successfully. Sep 06 22:42:05 devstack cinder-volume[87221]: DEBUG dbcounter [-] [87221] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:42:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 6 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:42:06 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:42:06 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:05 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:43:05 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:06 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.858s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:43:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:43:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 6 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:43:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Flow 'volume_create_manager' (b4687175-b79c-419e-acb0-e32f22075093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364febd6-056b-4e63-bec1-ab3df289b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364febd6-056b-4e63-bec1-ab3df289b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1661700293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bfa2ce-07af-4567-b23f-66ac03e50b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13123484340a4f05ad045e6e015f263e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:13Z,use_quota=True,user_id='e510a7d98b274a9f92fcbea3939cfb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cd0d87-2e17-480a-a18c-fdef179ee9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cd0d87-2e17-480a-a18c-fdef179ee9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a5e808-e66e-493d-8b4c-837cec2a61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a5e808-e66e-493d-8b4c-837cec2a61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bfa2ce-07af-4567-b23f-66ac03e50b78', 'volume_name': 'volume-08bfa2ce-07af-4567-b23f-66ac03e50b78', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43744cbf-1f42-4755-8f21-760fa5d237d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43744cbf-1f42-4755-8f21-760fa5d237d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40adc89-4df0-4a3f-90dd-daa84dba5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Volume 08bfa2ce-07af-4567-b23f-66ac03e50b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bfa2ce-07af-4567-b23f-66ac03e50b78', 'volume_size': 1} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1661700293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bfa2ce-07af-4567-b23f-66ac03e50b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13123484340a4f05ad045e6e015f263e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:13Z,use_quota=True,user_id='e510a7d98b274a9f92fcbea3939cfb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Creating volume 08bfa2ce-07af-4567-b23f-66ac03e50b78 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:43:13 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:13 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 1073741824 Sep 06 22:43:13 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:15 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 1073741824" returned: 0 in 1.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:15 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 Sep 06 22:43:15 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:16 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40adc89-4df0-4a3f-90dd-daa84dba5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bfa2ce-07af-4567-b23f-66ac03e50b78', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b30dc8-ff9b-4e99-a1a0-c3b12c8ee1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Volume volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 (08bfa2ce-07af-4567-b23f-66ac03e50b78): created successfully Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b30dc8-ff9b-4e99-a1a0-c3b12c8ee1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Flow 'volume_create_manager' (b4687175-b79c-419e-acb0-e32f22075093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-25afd3e7-1838-4a33-9e7a-5b2a39938f5a tempest-DeleteServersTestJSON-1540053020 None] Created volume successfully. Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Flow 'volume_create_manager' (143c1a7e-d0e6-4e0f-9f1e-116a80618e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7781cff-e242-4d88-a367-cbcd6ba00c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7781cff-e242-4d88-a367-cbcd6ba00c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1269969831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c976a75-16bd-4596-bf4d-b682e0184286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f531afd2ead4f99978d29ba2aae1f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:21Z,use_quota=True,user_id='5134ef1206214d41a9b5e8d94ec1b732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba743f33-6826-41d3-a925-92505020d893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba743f33-6826-41d3-a925-92505020d893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb26ef26-e8ff-44c1-8fa1-58e4bef3813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb26ef26-e8ff-44c1-8fa1-58e4bef3813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c976a75-16bd-4596-bf4d-b682e0184286', 'volume_name': 'volume-9c976a75-16bd-4596-bf4d-b682e0184286', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceb7227-710f-42d7-ab93-dfb745fd2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceb7227-710f-42d7-ab93-dfb745fd2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5962178-a95c-41c1-9bc1-04887657b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Volume 9c976a75-16bd-4596-bf4d-b682e0184286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c976a75-16bd-4596-bf4d-b682e0184286', 'volume_size': 1} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1269969831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c976a75-16bd-4596-bf4d-b682e0184286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f531afd2ead4f99978d29ba2aae1f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:21Z,use_quota=True,user_id='5134ef1206214d41a9b5e8d94ec1b732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Creating volume 9c976a75-16bd-4596-bf4d-b682e0184286 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:43:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:21 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 1073741824 Sep 06 22:43:21 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:22 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 1073741824" returned: 0 in 0.959s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:22 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 Sep 06 22:43:22 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:23 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5962178-a95c-41c1-9bc1-04887657b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c976a75-16bd-4596-bf4d-b682e0184286', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6597648-f1c2-4690-91c7-b67304e60dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Volume volume-9c976a75-16bd-4596-bf4d-b682e0184286 (9c976a75-16bd-4596-bf4d-b682e0184286): created successfully Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6597648-f1c2-4690-91c7-b67304e60dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Flow 'volume_create_manager' (143c1a7e-d0e6-4e0f-9f1e-116a80618e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1181b19f-c07c-4bc0-a335-5b60df4466ad tempest-VolumesAdminNegativeTest-552859511 None] Created volume successfully. Sep 06 22:43:23 devstack cinder-volume[87517]: WARNING py.warnings [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 06 22:43:23 devstack cinder-volume[87517]: .first() Sep 06 22:43:23 devstack cinder-volume[87517]: Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-08bfa2ce-07af-4567-b23f-66ac03e50b78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04297039-2e75-4193-8148-685b23596df5', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:43:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d465260f-08be-4aa9-a46f-adafab8d6b55 req-037c61ba-9d0b-4c21-af33-61bcbe61ae0d tempest-DeleteServersTestJSON-1540053020 None] attachment_update completed successfully. Sep 06 22:43:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Acquiring lock "cinder-9c976a75-16bd-4596-bf4d-b682e0184286-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "cinder-9c976a75-16bd-4596-bf4d-b682e0184286-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Acquiring lock "cinder-quobyte-9c976a75-16bd-4596-bf4d-b682e0184286" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "cinder-quobyte-9c976a75-16bd-4596-bf4d-b682e0184286" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:24 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp9shx7k9/privsep.sock'] Sep 06 22:43:24 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp9shx7k9/privsep.sock Sep 06 22:43:24 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 22:43:25 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 06 22:43:26 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:26 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Spawned new privsep daemon via rootwrap Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Accepted privsep connection to /tmp/tmpp9shx7k9/privsep.sock {{(pid=87517) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 06 22:43:26 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 06 22:43:26 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 06 22:43:26 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 06 22:43:26 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89159 Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6de68-849b-494d-9813-dd2c9aee2229]: (2,) {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4425dd1-9fd8-42f0-8ba8-3e9b66e0b0e2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:26 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 Sep 06 22:43:26 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:26 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286" returned: 0 in 0.715s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:26 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286 Sep 06 22:43:26 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:27 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9c976a75-16bd-4596-bf4d-b682e0184286" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "cinder-quobyte-9c976a75-16bd-4596-bf4d-b682e0184286" released by "delete_volume" :: held 2.786s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:43:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Created reservations ['73845cfd-f47e-47b6-9530-6f1683a23bc5', '0dd97cfb-a0ca-4da7-ae9b-ce0721c0b505', '1da14d9e-140f-4e4c-a3cc-708d4507d66c', 'bcdef406-4313-4cd2-8dd9-7917288e647c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:27 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:43:27 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:28 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.519s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:28 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:43:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Deleted volume successfully. Sep 06 22:43:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be951ec1-4fa1-4f5b-a571-df9840613f5d tempest-VolumesAdminNegativeTest-552859511 None] Lock "cinder-9c976a75-16bd-4596-bf4d-b682e0184286-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-cd059e30-e5a8-4f33-8f0d-a0971216c9bf req-d85f56dd-c5d7-4963-af95-69c33b296ef3 tempest-DeleteServersTestJSON-1540053020 None] Terminate volume connection completed successfully. Sep 06 22:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-cd059e30-e5a8-4f33-8f0d-a0971216c9bf req-d85f56dd-c5d7-4963-af95-69c33b296ef3 tempest-DeleteServersTestJSON-1540053020 None] Deleting attachment 04297039-2e75-4193-8148-685b23596df5. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "cinder-08bfa2ce-07af-4567-b23f-66ac03e50b78-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "cinder-08bfa2ce-07af-4567-b23f-66ac03e50b78-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "cinder-quobyte-08bfa2ce-07af-4567-b23f-66ac03e50b78" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "cinder-quobyte-08bfa2ce-07af-4567-b23f-66ac03e50b78" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b175d3a-3d4d-4c45-803d-5b168bc42bfa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:30 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 Sep 06 22:43:30 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:30 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:30 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78 Sep 06 22:43:30 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:31 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08bfa2ce-07af-4567-b23f-66ac03e50b78" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "cinder-quobyte-08bfa2ce-07af-4567-b23f-66ac03e50b78" released by "delete_volume" :: held 0.676s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Created reservations ['05636576-5ef2-4933-9d4f-84cd6f1d620b', 'e4677d51-a052-4d2a-af4a-f79b3eea63d1', '858105f6-a339-4939-b336-b2236630fa54', 'd030870c-fa78-4e65-9768-703e5fcaa0ed'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:31 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:43:31 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:31 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:43:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Deleted volume successfully. Sep 06 22:43:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-edd25200-ffac-4529-917b-186abbfc42a4 tempest-DeleteServersTestJSON-1540053020 None] Lock "cinder-08bfa2ce-07af-4567-b23f-66ac03e50b78-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Flow 'volume_create_manager' (d572a271-483e-43f5-9b92-77cc4af1a669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1deca7-2c3d-4dd2-873d-613094b79a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1deca7-2c3d-4dd2-873d-613094b79a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1715353672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac3c6f4-dd37-4148-b549-9e086c3798cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3025b635cc4eb9abbed561fe6f6d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:37Z,use_quota=True,user_id='2c93e6e81106456291fff3af85678130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafaf09d-8715-4f89-9c28-7f7359099ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafaf09d-8715-4f89-9c28-7f7359099ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c685f6f-0798-49fe-bbcd-51c0d3f3c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c685f6f-0798-49fe-bbcd-51c0d3f3c57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac3c6f4-dd37-4148-b549-9e086c3798cb', 'volume_name': 'volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e5e364-4a2c-4677-b684-1ad2f9ee8902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e5e364-4a2c-4677-b684-1ad2f9ee8902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cc02fb-5808-4bde-8a8a-8ee60287a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb', 'volume_size': 1} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1715353672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac3c6f4-dd37-4148-b549-9e086c3798cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3025b635cc4eb9abbed561fe6f6d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:37Z,use_quota=True,user_id='2c93e6e81106456291fff3af85678130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Creating volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:43:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:43:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:37 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb 1073741824 Sep 06 22:43:37 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:38 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb 1073741824" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:38 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb Sep 06 22:43:38 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:38 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cc02fb-5808-4bde-8a8a-8ee60287a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba231599-7703-469f-8449-3f632f7f0a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Volume volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb (7ac3c6f4-dd37-4148-b549-9e086c3798cb): created successfully Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba231599-7703-469f-8449-3f632f7f0a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Flow 'volume_create_manager' (d572a271-483e-43f5-9b92-77cc4af1a669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4d73495c-8c82-40fe-9ca8-89c5cdab5264 tempest-SnapshotsActionsTest-1808243176 None] Created volume successfully. Sep 06 22:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Creating offline snapshot 07e4054c-0834-41d3-951b-5221750c86b7 of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:43:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44a247f-1c88-40b9-ae19-d927dc3fd644]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:39 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb Sep 06 22:43:39 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:40 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:40 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 1G Sep 06 22:43:40 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:40 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 1G" returned: 0 in 0.477s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:40 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:40 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:40 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:40 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 is being set with open permissions: ugo+rw Sep 06 22:43:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:40 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:40 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:41 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:41 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info Sep 06 22:43:41 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:41 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:41 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info is being set with open permissions: ugo+rw Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:41 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info Sep 06 22:43:41 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:41 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.info" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3aeab7c1-2290-4e3d-b0a9-1b063a977472 tempest-SnapshotsActionsTest-1808243176 None] Create snapshot completed successfully Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Flow 'volume_create_manager' (492664e3-d917-47ba-b45e-0098eadf35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bc6876-6d17-4dc9-a4fa-e5731edc7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bc6876-6d17-4dc9-a4fa-e5731edc7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2040732787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fd2d020d6e45ce8d0c1a5271520b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:42Z,use_quota=True,user_id='433037baba47443f966aec4aba6b717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a88438-39d6-4eb5-8fbf-f91311769882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a88438-39d6-4eb5-8fbf-f91311769882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21bebe5-ad0f-4e93-a6bc-7de9efe93abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21bebe5-ad0f-4e93-a6bc-7de9efe93abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'volume_name': 'volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88abf2a0-d2b3-4901-9458-488e9adddb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88abf2a0-d2b3-4901-9458-488e9adddb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30686167-139b-4baa-8407-5ce945baea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Volume acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'volume_size': 1} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2040732787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fd2d020d6e45ce8d0c1a5271520b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:42Z,use_quota=True,user_id='433037baba47443f966aec4aba6b717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Creating volume acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:43:42 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:42 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 1073741824 Sep 06 22:43:42 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:42 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 1073741824" returned: 0 in 0.562s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:42 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 Sep 06 22:43:42 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:43 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30686167-139b-4baa-8407-5ce945baea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca642ea9-ab04-4991-b72d-0b09e523104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Volume volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 (acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33): created successfully Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca642ea9-ab04-4991-b72d-0b09e523104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Flow 'volume_create_manager' (492664e3-d917-47ba-b45e-0098eadf35ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-296d6744-55c8-4bd9-83e6-9630ea624eb5 tempest-ServerActionsTestOtherA-759551995 None] Created volume successfully. Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Creating offline snapshot ab71bf98-7ef3-42e0-b762-c981d9615fbe of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d865ec5-8f6d-4035-aae8-5c61f8c0b6a2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:43 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:43 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:44 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:44 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe 1G Sep 06 22:43:44 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:44 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe 1G" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:44 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe Sep 06 22:43:44 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:44 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:44 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe is being set with open permissions: ugo+rw Sep 06 22:43:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:44 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe Sep 06 22:43:44 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:45 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.660s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-727abafe-8de1-4cfe-b86a-4fb5edf815a8 tempest-SnapshotsActionsTest-1808243176 None] Create snapshot completed successfully Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-ab71bf98-7ef3-42e0-b762-c981d9615fbe-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-ab71bf98-7ef3-42e0-b762-c981d9615fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-ab71bf98-7ef3-42e0-b762-c981d9615fbe" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-ab71bf98-7ef3-42e0-b762-c981d9615fbe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Deleting offline snapshot ab71bf98-7ef3-42e0-b762-c981d9615fbe of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] snapshot_file for this snap is: volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982c247-ae05-40e7-9189-559e7187a5ee]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:46 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe Sep 06 22:43:46 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:46 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe" returned: 0 in 0.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a081910-d8f3-437b-a89b-d6dc295b9cbd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:46 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:46 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:46 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:46 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe Sep 06 22:43:46 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:47 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe" returned: 0 in 0.437s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:47 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe Sep 06 22:43:47 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:47 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ab71bf98-7ef3-42e0-b762-c981d9615fbe" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-ab71bf98-7ef3-42e0-b762-c981d9615fbe" released by "_delete_snapshot" :: held 1.743s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_snapshot" :: held 1.780s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:47 devstack cinder-volume[87517]: WARNING cinder.quota [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Created reservations ['c77465bd-3bff-4b32-8c4b-7950bc272e70', 'b1ea3175-567b-47dc-9575-8c367e1776f1', 'b206b968-fe60-44f5-8e9d-0d9ad5aa3384', '31623011-d78a-46cd-9854-2564e7cd8e99'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:43:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Delete snapshot completed successfully. Sep 06 22:43:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5950aa5e-4f68-4141-8d55-8cb4e3a81d2f tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-ab71bf98-7ef3-42e0-b762-c981d9615fbe-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Creating offline snapshot ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6f942-1c74-4bb5-bb2f-7ab165f541de]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:48 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:48 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:48 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.402s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:48 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 1G Sep 06 22:43:48 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:49 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 1G" returned: 0 in 0.550s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:49 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 Sep 06 22:43:49 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:49 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 is being set with open permissions: ugo+rw Sep 06 22:43:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:49 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 Sep 06 22:43:49 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:50 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.718s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b3b431ee-91cc-44c8-8941-9cc0d928fd30 tempest-SnapshotsActionsTest-1808243176 None] Create snapshot completed successfully Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Deleting offline snapshot ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] snapshot_file for this snap is: volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[93583b48-cf80-40f1-8ff8-0d6fb5d76b87]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:51 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 Sep 06 22:43:51 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:51 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f65ef0-9950-466e-8ca7-20780071361d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:51 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:51 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:52 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.592s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:52 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 Sep 06 22:43:52 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:52 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" returned: 0 in 0.619s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:52 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6 Sep 06 22:43:52 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:53 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6" released by "_delete_snapshot" :: held 2.232s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_snapshot" :: held 2.294s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:53 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Created reservations ['69d961a8-e4c1-4558-b42a-e0ce859119fe', '616d38fa-881b-457c-a64b-28dc17b15df5', '47bef3c6-ad64-4ea8-aca8-46fa471e36c3', 'b97c4b3f-618c-465c-bff3-9a6f4e4e23db'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:43:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Delete snapshot completed successfully. Sep 06 22:43:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6b0b1405-408d-4230-8087-601c30c77295 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-ad28a645-fa1a-4fff-9ad0-db0c2c65ecb6-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Creating offline snapshot 0bafccb0-dfbb-430c-8d90-368a99f3428e of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:43:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873f4e5-fa62-489d-bae9-13f53362823d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:54 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:54 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:55 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:55 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e 1G Sep 06 22:43:55 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:55 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e 1G" returned: 0 in 0.686s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:55 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e Sep 06 22:43:55 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:56 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:56 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e is being set with open permissions: ugo+rw Sep 06 22:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:56 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e Sep 06 22:43:56 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:56 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d595644b-3377-4b94-842f-8a7c5eaebd6a tempest-SnapshotsActionsTest-1808243176 None] Create snapshot completed successfully Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Flow 'volume_create_manager' (54dca8c2-9ce9-415b-b4b8-13ec3e2e0bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca4d1d-19d8-457b-b0b9-ac4254227176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ca4d1d-19d8-457b-b0b9-ac4254227176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-109936556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7757b4e-f3f7-4ef9-bebe-b86e8652df43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22e738eeaac6481dafae9789e55b0e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:58Z,use_quota=True,user_id='e61ace189f5349818e052e3af9905786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8b5d0f-2ad1-4ded-a4f0-f90adc4f2db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8b5d0f-2ad1-4ded-a4f0-f90adc4f2db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea44fd5-7d91-4100-abdf-ffe74b3bb256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea44fd5-7d91-4100-abdf-ffe74b3bb256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7757b4e-f3f7-4ef9-bebe-b86e8652df43', 'volume_name': 'volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2240174-5b57-45fc-86f4-b6c6cc3a9b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2240174-5b57-45fc-86f4-b6c6cc3a9b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2fcd85-030f-45e8-980c-1c020db67abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Volume a7757b4e-f3f7-4ef9-bebe-b86e8652df43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43', 'volume_size': 1} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-109936556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7757b4e-f3f7-4ef9-bebe-b86e8652df43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22e738eeaac6481dafae9789e55b0e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:43:58Z,use_quota=True,user_id='e61ace189f5349818e052e3af9905786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Creating volume a7757b4e-f3f7-4ef9-bebe-b86e8652df43 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:43:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:57 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 1073741824 Sep 06 22:43:57 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-0bafccb0-dfbb-430c-8d90-368a99f3428e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-0bafccb0-dfbb-430c-8d90-368a99f3428e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-0bafccb0-dfbb-430c-8d90-368a99f3428e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-0bafccb0-dfbb-430c-8d90-368a99f3428e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Deleting offline snapshot 0bafccb0-dfbb-430c-8d90-368a99f3428e of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] snapshot_file for this snap is: volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e1ba9-88bd-4ca1-8606-b7a261faf02b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:58 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 1073741824" returned: 0 in 0.607s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:58 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e Sep 06 22:43:58 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:58 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 Sep 06 22:43:58 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:58 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e" returned: 0 in 0.605s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae307324-b8d3-4a17-a7fb-77cbcb3623c9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:58 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" returned: 0 in 0.523s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2fcd85-030f-45e8-980c-1c020db67abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4448ef6e-b9a3-4a6e-86f3-fe04e75b3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:43:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Volume volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 (a7757b4e-f3f7-4ef9-bebe-b86e8652df43): created successfully Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4448ef6e-b9a3-4a6e-86f3-fe04e75b3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Flow 'volume_create_manager' (54dca8c2-9ce9-415b-b4b8-13ec3e2e0bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:43:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-2e4d63d5-0ee6-4208-b379-d789b545e6d0 req-a21d67fd-f0a7-42ac-ba0c-8db1889b35db tempest-VolumesGetTestJSON-643745672 None] Created volume successfully. Sep 06 22:43:59 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:43:59 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:43:59 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:43:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:43:59 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e Sep 06 22:43:59 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:00 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e" returned: 0 in 0.549s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Acquiring lock "cinder-a7757b4e-f3f7-4ef9-bebe-b86e8652df43-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:00 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e Sep 06 22:44:00 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "cinder-a7757b4e-f3f7-4ef9-bebe-b86e8652df43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Acquiring lock "cinder-quobyte-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "cinder-quobyte-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d79c9-dc3a-49c0-807f-4e7a2411af5a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:00 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.0bafccb0-dfbb-430c-8d90-368a99f3428e" returned: 0 in 0.415s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-0bafccb0-dfbb-430c-8d90-368a99f3428e" released by "_delete_snapshot" :: held 2.331s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_snapshot" :: held 2.368s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:00 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 Sep 06 22:44:00 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Created reservations ['7b1ccf50-ac49-407f-b5fe-d435b20975c1', 'bb69d59d-54c8-4b64-80f7-002e7a57be36', 'b361106d-61d2-4568-960b-0c54a9db10b4', '741c9fc5-b6a3-44b7-9bfa-69a738ad132a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Delete snapshot completed successfully. Sep 06 22:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c32b3fb-db84-4777-bfb9-662d48b69c24 tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-0bafccb0-dfbb-430c-8d90-368a99f3428e-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:00 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" returned: 0 in 0.699s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:01 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43 Sep 06 22:44:01 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:01 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "cinder-quobyte-a7757b4e-f3f7-4ef9-bebe-b86e8652df43" released by "delete_volume" :: held 1.191s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG cinder.quota [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Created reservations ['d65ebdfc-2d38-411d-9321-6b493359a524', 'a9143843-6943-4371-8134-389baeae1e8b', '09cd5274-59db-4ef6-a881-bf6968df965a', 'e1e8de5d-3892-46ac-8da1-7bdeaac6ca87'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:01 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:01 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:02 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG cinder.manager [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Deleted volume successfully. Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-4a68c13b-15c0-40f9-b25d-37bb552548b4 req-880ac93d-f828-4753-89cf-346e81f2df18 tempest-VolumesGetTestJSON-643745672 None] Lock "cinder-a7757b4e-f3f7-4ef9-bebe-b86e8652df43-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Creating offline snapshot 37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[951075a0-8bed-455c-9c63-e29db2ac136b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:02 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:44:02 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:02 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.562s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:03 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b 1G Sep 06 22:44:03 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:03 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b 1G" returned: 0 in 0.635s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:03 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b Sep 06 22:44:03 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:04 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" returned: 0 in 0.499s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:04 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b is being set with open permissions: ugo+rw Sep 06 22:44:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:04 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b Sep 06 22:44:04 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:04 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-de10afb4-68cb-4c11-a8fc-47aea8df173f tempest-SnapshotsActionsTest-1808243176 None] Create snapshot completed successfully Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:05 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:05 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Acquiring lock "cinder-quobyte-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Deleting offline snapshot 37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:06 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] snapshot_file for this snap is: volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193a6e0-eb2c-4d86-9f00-68c4a7107b6b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:06 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b Sep 06 22:44:06 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:06 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" returned: 0 in 0.539s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2805219-5057-4907-a594-9ee14400590f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:06 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:44:06 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:07 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:07 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b Sep 06 22:44:07 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:07 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" returned: 0 in 0.485s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:07 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b Sep 06 22:44:07 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:07 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b" released by "_delete_snapshot" :: held 1.962s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_snapshot" :: held 2.003s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:07 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=55,cinder:INSERT=18,cinder:UPDATE=65,cinder:DELETE=9 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:44:08 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=61,cinder:SELECT=67,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:44:08 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Created reservations ['b12ff1fb-3573-408c-a0da-47bf88e96bc1', '8f00fe79-17e5-4536-8f6b-55e7efda3744', '77cabfe2-9997-460c-868e-e2aa41e56d5d', 'fe51af7c-ffbc-448b-8eff-79dc7bfd9b90'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Delete snapshot completed successfully. Sep 06 22:44:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-317f707b-5973-49bc-b8cf-08f02f7df88d tempest-SnapshotsActionsTest-1620107680 None] Lock "cinder-37d5bcb1-6eb2-44f0-9706-ac76e4e6fc9b-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "cinder-07e4054c-0834-41d3-951b-5221750c86b7-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-07e4054c-0834-41d3-951b-5221750c86b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "cinder-quobyte-07e4054c-0834-41d3-951b-5221750c86b7" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-07e4054c-0834-41d3-951b-5221750c86b7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Deleting offline snapshot 07e4054c-0834-41d3-951b-5221750c86b7 of volume 7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] snapshot_file for this snap is: volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24130ca-b166-4bdc-a6e9-1dd02ac91999]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:09 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:44:09 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:09 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cf2d0-60a7-4c72-8b00-ff0bd2a7da69]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:09 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb Sep 06 22:44:09 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-63bd5b5e-9c44-4801-a0a4-41446d6108b0 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-734712621: creating Sep 06 22:44:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-63bd5b5e-9c44-4801-a0a4-41446d6108b0 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-734712621: created successfully Sep 06 22:44:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-63bd5b5e-9c44-4801-a0a4-41446d6108b0 tempest-GroupSnapshotsTest-1771170664 None] Create group completed successfully. Sep 06 22:44:10 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:10 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:44:10 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:10 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:10 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7 Sep 06 22:44:10 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:11 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb.07e4054c-0834-41d3-951b-5221750c86b7" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-07e4054c-0834-41d3-951b-5221750c86b7" released by "_delete_snapshot" :: held 1.949s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_snapshot" :: held 1.987s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Created reservations ['5868cd48-f468-41ad-bd0c-d2800c6230f0', '9c54b1fa-ca64-4058-84ab-feac0976521e', '08e337df-1e70-4769-84e1-a361505a7287', 'bed589a2-cbaf-42a1-8ce4-77fa95b444e8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Delete snapshot completed successfully. Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dfd4f9c2-92f2-4bca-9962-0bdc0549ecb1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-07e4054c-0834-41d3-951b-5221750c86b7-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (e324cc93-1954-4ce2-acd9-c287d56494db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f363f63-eb70-401e-a839-8ca4cabca99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f363f63-eb70-401e-a839-8ca4cabca99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-66435698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7c4dff-ce2d-4ab3-bdc6-ea01e7bcb7b7,host='devstack@QuobyteHD#QuobyteHD',id=482ac797-5662-4e5c-8a8d-878eec406a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:12Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d2e16a3-b2b7-411b-be0c-3d252af2564e),volume_type_id=5d2e16a3-b2b7-411b-be0c-3d252af2564e)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313593c5-720c-4a11-b3f0-5f70802f4d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313593c5-720c-4a11-b3f0-5f70802f4d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f25b86-6c75-47f0-bcc2-4ea6d44fa820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f25b86-6c75-47f0-bcc2-4ea6d44fa820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482ac797-5662-4e5c-8a8d-878eec406a79', 'volume_name': 'volume-482ac797-5662-4e5c-8a8d-878eec406a79', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91061d9-4c26-4b19-9516-9f9171dbb073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91061d9-4c26-4b19-9516-9f9171dbb073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b000d9eb-9180-487a-b418-6ac509aac820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Volume 482ac797-5662-4e5c-8a8d-878eec406a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482ac797-5662-4e5c-8a8d-878eec406a79', 'volume_size': 1} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d7c4dff-ce2d-4ab3-bdc6-ea01e7bcb7b7,created_at=2026-09-06T20:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-66435698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7c4dff-ce2d-4ab3-bdc6-ea01e7bcb7b7,host='devstack@QuobyteHD#QuobyteHD',id=482ac797-5662-4e5c-8a8d-878eec406a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:12Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d2e16a3-b2b7-411b-be0c-3d252af2564e),volume_type_id=5d2e16a3-b2b7-411b-be0c-3d252af2564e)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Creating volume 482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:11 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 1073741824 Sep 06 22:44:11 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:12 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 1073741824" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "cinder-7ac3c6f4-dd37-4148-b549-9e086c3798cb-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:12 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:12 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-7ac3c6f4-dd37-4148-b549-9e086c3798cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e48819-d346-48d9-a5a0-8bbcb65854e0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:12 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb Sep 06 22:44:12 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:12 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b000d9eb-9180-487a-b418-6ac509aac820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482ac797-5662-4e5c-8a8d-878eec406a79', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7a837b-5b80-4201-bf59-4593b9f1b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Volume volume-482ac797-5662-4e5c-8a8d-878eec406a79 (482ac797-5662-4e5c-8a8d-878eec406a79): created successfully Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7a837b-5b80-4201-bf59-4593b9f1b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (e324cc93-1954-4ce2-acd9-c287d56494db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8b873ce2-0ae8-4054-a1d8-efad48e98253 tempest-GroupSnapshotsTest-1771170664 None] Created volume successfully. Sep 06 22:44:12 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb" returned: 0 in 0.389s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:12 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb Sep 06 22:44:12 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:13 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7ac3c6f4-dd37-4148-b549-9e086c3798cb" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-quobyte-7ac3c6f4-dd37-4148-b549-9e086c3798cb" released by "delete_volume" :: held 0.718s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] GroupSnapshot e826248c-6345-444d-a302-6d2c9fdd0664: creating. Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Created reservations ['6088bbb9-af1e-430f-89e1-72f2f187fd4b', 'f7e5bfc1-d2c8-45ea-96d9-30e1a92f0a49', 'be475830-17dd-47f0-9983-5a3c1cbdbaa0', 'c283e7f9-3118-44ae-abfa-7872ed5280e2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Group snapshot e826248c-6345-444d-a302-6d2c9fdd0664: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Creating offline snapshot a0df716b-0a22-4bb7-b061-ee3348328d26 of volume 482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef421c21-b560-4178-a508-0b613d752034]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:13 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:13 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:13 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:13 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:13 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Deleted volume successfully. Sep 06 22:44:13 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.439s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:13 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 1G Sep 06 22:44:13 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Flow 'volume_create_manager' (ac0dd672-31b7-4edb-acfd-7a9d149e5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408522c-57fd-4cbf-bffb-5b62426688b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408522c-57fd-4cbf-bffb-5b62426688b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-282548054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa2831b-1252-4f95-ad75-da43f25d0962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e567c304b284354af82b5eec8ab50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:14Z,use_quota=True,user_id='cfb8de09f03e40959bd79ab7ff66d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2946208c-4349-43a8-9a2e-7cddfee5a865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2946208c-4349-43a8-9a2e-7cddfee5a865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e787dc88-b860-4895-a672-d6587b4df737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e787dc88-b860-4895-a672-d6587b4df737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa2831b-1252-4f95-ad75-da43f25d0962', 'volume_name': 'volume-6fa2831b-1252-4f95-ad75-da43f25d0962', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0327de01-b0df-4240-b04b-bd44d4fd0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0327de01-b0df-4240-b04b-bd44d4fd0813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81762cd1-ba51-4d35-b6df-a50903c92844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Volume 6fa2831b-1252-4f95-ad75-da43f25d0962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa2831b-1252-4f95-ad75-da43f25d0962', 'volume_size': 1} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b536b465-7966-4e8a-a3de-c519c303e1e1 tempest-SnapshotsActionsTest-1808243176 None] Lock "cinder-7ac3c6f4-dd37-4148-b549-9e086c3798cb-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:14 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 1G" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482ac797-5662-4e5c-8a8d-878eec406a79 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:14 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482ac797-5662-4e5c-8a8d-878eec406a79 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:14 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:14 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-482ac797-5662-4e5c-8a8d-878eec406a79 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:14 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:14 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:14 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:14 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info Sep 06 22:44:14 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:15 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:15 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info Sep 06 22:44:15 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:15 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.info" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-282548054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa2831b-1252-4f95-ad75-da43f25d0962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e567c304b284354af82b5eec8ab50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:14Z,use_quota=True,user_id='cfb8de09f03e40959bd79ab7ff66d85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Creating volume 6fa2831b-1252-4f95-ad75-da43f25d0962 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:15 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 1073741824 Sep 06 22:44:15 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-63679036-0db9-4460-a7b1-ac50d67905cf tempest-GroupSnapshotsTest-1771170664 None] group_snapshot e826248c-6345-444d-a302-6d2c9fdd0664: created successfully Sep 06 22:44:15 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 1073741824" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:15 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 Sep 06 22:44:15 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:16 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81762cd1-ba51-4d35-b6df-a50903c92844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa2831b-1252-4f95-ad75-da43f25d0962', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4d0f7-5c36-4d54-a971-4b3befb15405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Volume volume-6fa2831b-1252-4f95-ad75-da43f25d0962 (6fa2831b-1252-4f95-ad75-da43f25d0962): created successfully Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4d0f7-5c36-4d54-a971-4b3befb15405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Flow 'volume_create_manager' (ac0dd672-31b7-4edb-acfd-7a9d149e5717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d41743e2-1050-4f09-b4b1-e7e097893a2d tempest-TaggedAttachmentsTest-1470021961 None] Created volume successfully. Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Creating volume 0dc741cb-d3e3-481d-bdef-1c0a42f2d97a from snapshot a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] snapshot: a0df716b-0a22-4bb7-b061-ee3348328d26, volume: 0dc741cb-d3e3-481d-bdef-1c0a42f2d97a, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a0cd6-b047-407d-8953-a16c2c5149ae]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:17 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:17 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:17 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.464s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482ac797-5662-4e5c-8a8d-878eec406a79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b6a040-c840-42a4-a152-cc48734f7d10]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:17 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:17 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:18 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:44:18 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:18 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a Sep 06 22:44:18 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Flow 'volume_create_manager' (25644301-14ca-4d94-b009-bb2094a3f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc50c51-37cf-4c9d-9aee-75cf863e5b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc50c51-37cf-4c9d-9aee-75cf863e5b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-259797858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2791dc86-e51c-4d5b-8960-2799c2a2f112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e36aecb513419583aa4228cb7690d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:22Z,use_quota=True,user_id='84cf66590be7465188980c1f5fb3a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8071cb1-d5ee-4073-933e-ff4c07a2c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8071cb1-d5ee-4073-933e-ff4c07a2c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a4810-2c60-43f9-841f-9ae95be72a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723a4810-2c60-43f9-841f-9ae95be72a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2791dc86-e51c-4d5b-8960-2799c2a2f112', 'volume_name': 'volume-2791dc86-e51c-4d5b-8960-2799c2a2f112', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eccd75f-1a3d-4e87-b0ef-9356c5111bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eccd75f-1a3d-4e87-b0ef-9356c5111bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee0b3c1-c6af-47d6-9a21-883c92e820cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Volume 2791dc86-e51c-4d5b-8960-2799c2a2f112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2791dc86-e51c-4d5b-8960-2799c2a2f112', 'volume_size': 1} Sep 06 22:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:24 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" returned: 0 in 6.227s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:44:24 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Converted 1024.00 MB image at 164.35 MB/s Sep 06 22:44:24 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:24 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a Sep 06 22:44:24 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:24 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" released by "_copy_volume_from_snapshot" :: held 7.441s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" released by "_create_volume_from_snapshot" :: held 7.537s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.559s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.891s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-259797858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2791dc86-e51c-4d5b-8960-2799c2a2f112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e36aecb513419583aa4228cb7690d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:22Z,use_quota=True,user_id='84cf66590be7465188980c1f5fb3a2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Creating volume 2791dc86-e51c-4d5b-8960-2799c2a2f112 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:24 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:24 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 1073741824 Sep 06 22:44:24 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2551dc9a-c977-45b5-a96b-09be8b5c94ca tempest-GroupSnapshotsTest-1771170664 None] Create group from source-snapshot-e826248c-6345-444d-a302-6d2c9fdd0664 completed successfully. Sep 06 22:44:25 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 1073741824" returned: 0 in 0.655s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:25 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 Sep 06 22:44:25 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:25 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee0b3c1-c6af-47d6-9a21-883c92e820cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2791dc86-e51c-4d5b-8960-2799c2a2f112', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489fba75-1f76-48b3-89fc-2dfcc51e1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Volume volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 (2791dc86-e51c-4d5b-8960-2799c2a2f112): created successfully Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489fba75-1f76-48b3-89fc-2dfcc51e1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Flow 'volume_create_manager' (25644301-14ca-4d94-b009-bb2094a3f43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c93f4a8d-3633-4f57-b545-5894d15359e4 tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Created volume successfully. Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f7af4e-c064-45cb-b823-5f58ea4a148a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:26 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a Sep 06 22:44:26 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-def53b7a-291b-4b9e-ab5a-51f961614b4a req-b84c2313-1d6e-4313-bfd3-c2087e29de7c tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-def53b7a-291b-4b9e-ab5a-51f961614b4a req-b84c2313-1d6e-4313-bfd3-c2087e29de7c tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-def53b7a-291b-4b9e-ab5a-51f961614b4a req-b84c2313-1d6e-4313-bfd3-c2087e29de7c tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-def53b7a-291b-4b9e-ab5a-51f961614b4a req-b84c2313-1d6e-4313-bfd3-c2087e29de7c tempest-ServerActionsTestOtherA-759551995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3d07854-29d6-4ed4-a407-b865e86169a5', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:44:26 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" returned: 0 in 0.471s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:26 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a Sep 06 22:44:26 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-def53b7a-291b-4b9e-ab5a-51f961614b4a req-b84c2313-1d6e-4313-bfd3-c2087e29de7c tempest-ServerActionsTestOtherA-759551995 None] attachment_update completed successfully. Sep 06 22:44:27 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0dc741cb-d3e3-481d-bdef-1c0a42f2d97a" released by "delete_volume" :: held 0.868s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['97288fad-af89-4b20-9e90-eccb4c1ffffc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-511490865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-511490865, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:44:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-511490865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-511490865, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['24699f02-e526-4a62-9397-cc5b2e7ab806', 'bb5003e5-01ed-4cde-9ea4-f7e812359b99', 'e68f6f0a-6f8a-4d64-9583-e6297ec21e5d', '6b0d9d2e-84af-421d-a971-d9d0e72b1a7e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:27 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:27 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] group_snapshot e826248c-6345-444d-a302-6d2c9fdd0664: deleting Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] group_snapshot e826248c-6345-444d-a302-6d2c9fdd0664: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:27 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.472s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cac71b5a-b597-4408-b25d-5ff9e6b27a94 tempest-GroupSnapshotsTest-1771170664 None] Delete group completed successfully. Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Deleting offline snapshot a0df716b-0a22-4bb7-b061-ee3348328d26 of volume 482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] snapshot_file for this snap is: volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[caffef5e-622f-4755-bd67-4c6d63fa0888]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:28 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:28 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:28 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.492s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482ac797-5662-4e5c-8a8d-878eec406a79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254b08a-d10c-45fb-86f2-79d8fda7c1a5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:28 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:28 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Acquiring lock "cinder-2791dc86-e51c-4d5b-8960-2799c2a2f112-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "cinder-2791dc86-e51c-4d5b-8960-2799c2a2f112-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Acquiring lock "cinder-quobyte-2791dc86-e51c-4d5b-8960-2799c2a2f112" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "cinder-quobyte-2791dc86-e51c-4d5b-8960-2799c2a2f112" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d686771f-154c-452f-80b3-4eeb0aa506fa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:29 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 Sep 06 22:44:29 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:29 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.895s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:29 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:29 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:30 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112" returned: 0 in 0.785s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:30 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.635s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:30 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26 Sep 06 22:44:30 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:30 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112 Sep 06 22:44:30 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:30 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79.a0df716b-0a22-4bb7-b061-ee3348328d26" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:30 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2791dc86-e51c-4d5b-8960-2799c2a2f112" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-a0df716b-0a22-4bb7-b061-ee3348328d26" released by "_delete_snapshot" :: held 2.569s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" released by "delete_snapshot" :: held 2.606s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "cinder-quobyte-2791dc86-e51c-4d5b-8960-2799c2a2f112" released by "delete_volume" :: held 1.282s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:30 devstack cinder-volume[87517]: WARNING cinder.quota [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-511490865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-511490865, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Created reservations ['3320557f-4bc9-4dd7-9d8a-afc6ba65daac', '3511c4a3-364f-4904-a811-dfc18598c787', '682abe9e-7376-4cf6-8fd6-4a26086b5860', '643f875d-7256-440f-ac9b-7c42d10978fc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['6dfcb8f7-e820-49bf-bde3-e6329a7a103e', '91708ee7-c4d7-4cdc-a642-a70c4f05d22d', 'c23db748-be43-4c1d-82ae-58aed6d42203', 'b2a99f0b-fc0c-4240-9739-a0c8780a0c81'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:30 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:30 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-40523de2-0335-48ae-a55b-6d1f76adff31 tempest-GroupSnapshotsTest-1771170664 None] group_snapshot e826248c-6345-444d-a302-6d2c9fdd0664: deleted successfully Sep 06 22:44:31 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.452s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Deleted volume successfully. Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5d88e20-df3a-4599-a5f9-69083eee79de tempest-VolumeQuotasNegativeTestJSON-1849177489 None] Lock "cinder-2791dc86-e51c-4d5b-8960-2799c2a2f112-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219f8f9-07cd-43c7-bf63-ab48d01a6a36]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:32 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:32 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-77699b6e-07d9-405f-a294-e5a86e2ac026 tempest-ServerActionsTestOtherA-759551995 None] Terminate volume connection completed successfully. Sep 06 22:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-77699b6e-07d9-405f-a294-e5a86e2ac026 tempest-ServerActionsTestOtherA-759551995 None] Deleting attachment e3d07854-29d6-4ed4-a407-b865e86169a5. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:44:32 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.696s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:32 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79 Sep 06 22:44:32 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:33 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-482ac797-5662-4e5c-8a8d-878eec406a79" returned: 0 in 0.585s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-482ac797-5662-4e5c-8a8d-878eec406a79" released by "delete_volume" :: held 1.393s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['b7e3c281-94cb-4d1e-ba9f-8af1da1699db'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:33 devstack cinder-volume[87517]: WARNING cinder.db.api [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-511490865'] Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['a5135d5e-0e98-4730-8da4-ce528f3f995b', '122b24af-1761-4fe6-8cb5-f350ca6149bb', 'e106dc6c-f5c1-46cc-bdeb-225df59faaa3', '48472ec2-c6ce-44a5-87d5-77b3d6c8896b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:33 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:33 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-6800575c-21f0-4318-8a5e-cbbe9c3778d7 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-6800575c-21f0-4318-8a5e-cbbe9c3778d7 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-6800575c-21f0-4318-8a5e-cbbe9c3778d7 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-6800575c-21f0-4318-8a5e-cbbe9c3778d7 tempest-ServerActionsTestOtherA-759551995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17cb231e-b11c-4596-9c24-a9e501c59ff5', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:44:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-883fae32-a669-4ae5-9a35-a8e43b52a33f req-6800575c-21f0-4318-8a5e-cbbe9c3778d7 tempest-ServerActionsTestOtherA-759551995 None] attachment_update completed successfully. Sep 06 22:44:34 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cdb8db5e-8ef9-440c-9742-f701be993abb tempest-GroupSnapshotsTest-1771170664 None] Delete group completed successfully. Sep 06 22:44:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-235b9cf5-33e3-4969-ba60-72c742742578 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-1580394850: creating Sep 06 22:44:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-235b9cf5-33e3-4969-ba60-72c742742578 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-1580394850: created successfully Sep 06 22:44:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-235b9cf5-33e3-4969-ba60-72c742742578 tempest-GroupSnapshotsTest-1771170664 None] Create group completed successfully. Sep 06 22:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (339c4ec2-41f4-4d76-8949-f62f93866a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b4298-a029-427a-8a33-6028a3feec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b4298-a029-427a-8a33-6028a3feec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248303238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,host='devstack@QuobyteHD#QuobyteHD',id=b0f58da7-76b4-4dfe-a0a1-41ec539e59c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:38Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(220f1b03-b41a-41bc-9f6f-df8f03c58643),volume_type_id=220f1b03-b41a-41bc-9f6f-df8f03c58643)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9666cc28-1415-4d4b-a09c-716a6543113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9666cc28-1415-4d4b-a09c-716a6543113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec3e695-04c4-4b39-abc1-840a59f0f560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec3e695-04c4-4b39-abc1-840a59f0f560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f58da7-76b4-4dfe-a0a1-41ec539e59c0', 'volume_name': 'volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20bd485-cfc4-4b5a-8496-82f3b33ce3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20bd485-cfc4-4b5a-8496-82f3b33ce3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6039d7be-d60e-406e-b6b0-8984cd98ffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Volume b0f58da7-76b4-4dfe-a0a1-41ec539e59c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0', 'volume_size': 1} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,created_at=2026-09-06T20:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248303238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,host='devstack@QuobyteHD#QuobyteHD',id=b0f58da7-76b4-4dfe-a0a1-41ec539e59c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:38Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(220f1b03-b41a-41bc-9f6f-df8f03c58643),volume_type_id=220f1b03-b41a-41bc-9f6f-df8f03c58643)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Creating volume b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:38 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:38 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 1073741824 Sep 06 22:44:38 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:39 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 1073741824" returned: 0 in 0.976s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:39 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 Sep 06 22:44:39 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:39 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" returned: 0 in 0.545s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6039d7be-d60e-406e-b6b0-8984cd98ffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550687b3-dbe4-4878-92cc-b8d15bbfa68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Volume volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 (b0f58da7-76b4-4dfe-a0a1-41ec539e59c0): created successfully Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550687b3-dbe4-4878-92cc-b8d15bbfa68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (339c4ec2-41f4-4d76-8949-f62f93866a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-704f7cd1-2573-4814-a022-6afa1bc9ecf2 tempest-GroupSnapshotsTest-1771170664 None] Created volume successfully. Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (564eb8f6-44dd-4860-be5c-bbef31c17727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6735930-f206-4f5e-8a2a-3a515a6f702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6735930-f206-4f5e-8a2a-3a515a6f702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862325171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,host='devstack@QuobyteHD#QuobyteHD',id=0f870983-8e4b-465c-aa93-a14d9c7ece1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:42Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(220f1b03-b41a-41bc-9f6f-df8f03c58643),volume_type_id=220f1b03-b41a-41bc-9f6f-df8f03c58643)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09da3f4-075b-4572-ba80-345cc7bf1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09da3f4-075b-4572-ba80-345cc7bf1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4d91c6-b19c-409e-ac4d-1482e08855fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4d91c6-b19c-409e-ac4d-1482e08855fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f870983-8e4b-465c-aa93-a14d9c7ece1b', 'volume_name': 'volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61c0508-a2f5-4527-8945-d13cc1c1886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61c0508-a2f5-4527-8945-d13cc1c1886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcd908b-2df0-413b-bcdb-ce0c6caa4be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Volume 0f870983-8e4b-465c-aa93-a14d9c7ece1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b', 'volume_size': 1} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,created_at=2026-09-06T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862325171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff872ae7-3f3f-49c6-8e52-d590b00ca2ea,host='devstack@QuobyteHD#QuobyteHD',id=0f870983-8e4b-465c-aa93-a14d9c7ece1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:42Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(220f1b03-b41a-41bc-9f6f-df8f03c58643),volume_type_id=220f1b03-b41a-41bc-9f6f-df8f03c58643)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Creating volume 0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:41 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:41 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b 1073741824 Sep 06 22:44:41 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:42 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b 1073741824" returned: 0 in 0.570s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:42 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b Sep 06 22:44:42 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Flow 'volume_create_manager' (6079ccfd-a176-4502-9d00-5d814f427149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff3f415-9d14-4e72-9057-458b0faf0b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff3f415-9d14-4e72-9057-458b0faf0b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-193655997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c46f14-b557-46c4-aa26-20ba159e6790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a6f55a95fa45f19f5ece20bb4f5d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:43Z,use_quota=True,user_id='8c8b1a006f824e84b0f29ee989bba4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0543753-fa7b-4c60-929e-7b27010ff2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0543753-fa7b-4c60-929e-7b27010ff2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70c3dd4-e766-4f14-9f71-ebef713dc193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70c3dd4-e766-4f14-9f71-ebef713dc193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c46f14-b557-46c4-aa26-20ba159e6790', 'volume_name': 'volume-b5c46f14-b557-46c4-aa26-20ba159e6790', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb315884-9194-4325-b7c7-b9479093173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb315884-9194-4325-b7c7-b9479093173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86621980-fc85-4e2e-ba3d-5e7b5aace1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Volume b5c46f14-b557-46c4-aa26-20ba159e6790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c46f14-b557-46c4-aa26-20ba159e6790', 'volume_size': 1} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:42 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-193655997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c46f14-b557-46c4-aa26-20ba159e6790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a6f55a95fa45f19f5ece20bb4f5d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:43Z,use_quota=True,user_id='8c8b1a006f824e84b0f29ee989bba4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Creating volume b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:42 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcd908b-2df0-413b-bcdb-ce0c6caa4be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 1073741824 Sep 06 22:44:42 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3071049d-561b-461b-98ac-0d1e606af1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Volume volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b (0f870983-8e4b-465c-aa93-a14d9c7ece1b): created successfully Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3071049d-561b-461b-98ac-0d1e606af1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (564eb8f6-44dd-4860-be5c-bbef31c17727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0fe25dfc-6ee5-44cd-b9f7-1d7e7ce42c89 tempest-GroupSnapshotsTest-1771170664 None] Created volume successfully. Sep 06 22:44:43 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 1073741824" returned: 0 in 0.465s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:43 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 Sep 06 22:44:43 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:43 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86621980-fc85-4e2e-ba3d-5e7b5aace1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c46f14-b557-46c4-aa26-20ba159e6790', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72346836-d8a1-4a3d-a016-770fb98e116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Volume volume-b5c46f14-b557-46c4-aa26-20ba159e6790 (b5c46f14-b557-46c4-aa26-20ba159e6790): created successfully Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72346836-d8a1-4a3d-a016-770fb98e116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Flow 'volume_create_manager' (6079ccfd-a176-4502-9d00-5d814f427149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-74583471-717c-404e-b8ae-19bae7986480 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Created volume successfully. Sep 06 22:44:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-82f433d3-2a5e-468b-ac8d-5dcc321d33ce tempest-GroupSnapshotsTest-1771170664 None] Update group completed successfully. Sep 06 22:44:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Creating offline snapshot c7e21f69-8775-472d-9500-a250e47feaf4 of volume b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:44:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4f4ba-40de-43b0-9ad3-3470ba5d2286]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:45 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 Sep 06 22:44:45 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:45 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:45 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 1G Sep 06 22:44:45 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0fd84399-5a23-49bb-a363-c483dc68f432 tempest-GroupSnapshotsTest-1771170664 None] Update group completed successfully. Sep 06 22:44:45 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 1G" returned: 0 in 0.494s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c46f14-b557-46c4-aa26-20ba159e6790 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:45 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c46f14-b557-46c4-aa26-20ba159e6790 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 Sep 06 22:44:45 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:46 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c46f14-b557-46c4-aa26-20ba159e6790 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:46 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 is being set with open permissions: ugo+rw Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:46 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 Sep 06 22:44:46 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:46 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:46 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info Sep 06 22:44:46 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:46 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:46 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info is being set with open permissions: ugo+rw Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:46 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info Sep 06 22:44:46 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e782919e-8ab1-4d18-afd9-e0b8b3641d42 tempest-GroupSnapshotsTest-1771170664 None] Update group completed successfully. Sep 06 22:44:46 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.info" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5c3f44de-7a52-442b-969b-8b2a6c5d713f tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Create snapshot completed successfully Sep 06 22:44:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-54448ffd-757e-40fe-bcc5-16f889e29acf tempest-GroupSnapshotsTest-1771170664 None] Update group completed successfully. Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "cinder-c7e21f69-8775-472d-9500-a250e47feaf4-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-c7e21f69-8775-472d-9500-a250e47feaf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "cinder-quobyte-c7e21f69-8775-472d-9500-a250e47feaf4" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-c7e21f69-8775-472d-9500-a250e47feaf4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Deleting offline snapshot c7e21f69-8775-472d-9500-a250e47feaf4 of volume b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] snapshot_file for this snap is: volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e40c0-4526-471e-b94d-11136d2c78e2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:48 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 Sep 06 22:44:48 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:48 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5c46f14-b557-46c4-aa26-20ba159e6790(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb6feb-145d-44c7-bf3a-406a340f8970]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:49 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 Sep 06 22:44:49 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:49 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:49 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 Sep 06 22:44:49 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] GroupSnapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: creating. Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Group snapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Creating offline snapshot cb3cb68e-bd29-469c-847b-a1ea80e4425c of volume b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5df7a3-d4c2-4e36-889a-22b09302f9a3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:49 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 Sep 06 22:44:49 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:49 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4" returned: 0 in 0.428s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:49 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4 Sep 06 22:44:49 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:49 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:49 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c 1G Sep 06 22:44:49 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:50 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790.c7e21f69-8775-472d-9500-a250e47feaf4" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-c7e21f69-8775-472d-9500-a250e47feaf4" released by "_delete_snapshot" :: held 1.605s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" released by "delete_snapshot" :: held 1.629s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Created reservations ['a8ba5b84-89ff-4cd3-9543-93790dae95a7', '6284c157-a4f0-4734-a015-4db3cf7de74a', '8e7c5c9f-2312-4a41-a724-046619ad78b5', '640f5806-b480-4a9c-b6c1-cc267ba4ccc8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Delete snapshot completed successfully. Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b0d3805-66b9-4a98-939f-e81f96706894 tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-c7e21f69-8775-472d-9500-a250e47feaf4-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:50 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c 1G" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:50 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c Sep 06 22:44:50 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:50 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:50 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:50 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c Sep 06 22:44:50 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "cinder-b5c46f14-b557-46c4-aa26-20ba159e6790-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-b5c46f14-b557-46c4-aa26-20ba159e6790-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055ad07-a7f6-4e60-8eb8-939219ee9d70]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:50 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 Sep 06 22:44:50 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:50 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:50 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info Sep 06 22:44:51 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:51 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:51 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:51 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790 Sep 06 22:44:51 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:51 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info Sep 06 22:44:51 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:51 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b5c46f14-b557-46c4-aa26-20ba159e6790" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-quobyte-b5c46f14-b557-46c4-aa26-20ba159e6790" released by "delete_volume" :: held 0.705s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:51 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.info" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Creating offline snapshot fd93f9d8-48c9-485a-a12c-d56431b3da87 of volume 0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b4439-8e5f-42c4-9e24-c386bf70fac2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Created reservations ['7c1313e0-583a-4779-97d0-2c763f038c3c', '9124bb80-8d09-42f4-95dd-94d5ac439359', '8cec0579-f413-4209-85f6-85b688d31961', 'ed2f454f-3bcb-4d7d-a699-6f17f83683cd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:51 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b Sep 06 22:44:51 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:51 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:44:51 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:51 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:44:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Deleted volume successfully. Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-be1d7654-2a5f-4fcd-b24c-9b2fc88645fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1417945445 None] Lock "cinder-b5c46f14-b557-46c4-aa26-20ba159e6790-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:51 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b" returned: 0 in 0.428s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:52 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 1G Sep 06 22:44:52 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:52 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 1G" returned: 0 in 0.589s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:52 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 Sep 06 22:44:52 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:52 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:52 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:53 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 Sep 06 22:44:53 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:53 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:53 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info Sep 06 22:44:53 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:53 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:53 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:44:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:53 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info Sep 06 22:44:53 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:54 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.info" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e6e78d7d-0bef-4907-bb57-14cc81dd1d5f tempest-GroupSnapshotsTest-1771170664 None] group_snapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: created successfully Sep 06 22:44:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] group_snapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: deleting Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] group_snapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-cb3cb68e-bd29-469c-847b-a1ea80e4425c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-cb3cb68e-bd29-469c-847b-a1ea80e4425c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Deleting offline snapshot cb3cb68e-bd29-469c-847b-a1ea80e4425c of volume b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] snapshot_file for this snap is: volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab08f3-7812-4249-bc62-aa9a6a0aaf85]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:55 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c Sep 06 22:44:55 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:55 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253a6f2-433a-480b-a3eb-64818448b5f6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:55 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 Sep 06 22:44:55 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:55 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" returned: 0 in 0.431s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:56 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c Sep 06 22:44:56 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:56 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:56 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c Sep 06 22:44:56 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:56 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0.cb3cb68e-bd29-469c-847b-a1ea80e4425c" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-cb3cb68e-bd29-469c-847b-a1ea80e4425c" released by "_delete_snapshot" :: held 1.649s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" released by "delete_snapshot" :: held 1.676s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-fd93f9d8-48c9-485a-a12c-d56431b3da87" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-fd93f9d8-48c9-485a-a12c-d56431b3da87" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Deleting offline snapshot fd93f9d8-48c9-485a-a12c-d56431b3da87 of volume 0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] snapshot_file for this snap is: volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ec541-e16d-43d0-b926-86ecad2e5b48]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:56 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 Sep 06 22:44:56 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:57 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b48a57-b307-4c08-ade2-0e3a4938a1f5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:57 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b Sep 06 22:44:57 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:57 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:57 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 Sep 06 22:44:57 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:58 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:58 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87 Sep 06 22:44:58 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:58 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b.fd93f9d8-48c9-485a-a12c-d56431b3da87" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-fd93f9d8-48c9-485a-a12c-d56431b3da87" released by "_delete_snapshot" :: held 1.722s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" released by "delete_snapshot" :: held 1.758s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:44:58 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-480144 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-480144, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:44:58 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-480144 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-480144, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['f8cc51a4-ecfc-464f-a0c3-8c4bb2b98aee', '304f257c-c5d4-44db-95a3-48bb42cca03c', '40a7b7e4-43fa-4f30-a4c8-6257243fadbf', '82a19287-a2c3-4c76-a198-396876e5072a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['1ba3d8fb-76b7-4662-b24f-558acf821d9a', '92a26316-60fe-4d26-929b-a43023596c6b', 'bd310b90-40ba-4ca6-8bbe-8e21474062dc', '32db6c0d-4f2e-4f98-b85d-99a4b40163f3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (76390b9f-bc10-4db0-a14c-eb556866a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581151e6-3b0b-4aa3-8d43-3f0372408b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581151e6-3b0b-4aa3-8d43-3f0372408b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-832604200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445ea8ef-c8a9-4568-b30e-716dc532c3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:59Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0b86d2-d539-4d1d-8f21-9482d00ac1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0b86d2-d539-4d1d-8f21-9482d00ac1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f4dcc-40f6-4643-8c6c-bb8ee9c2adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f4dcc-40f6-4643-8c6c-bb8ee9c2adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445ea8ef-c8a9-4568-b30e-716dc532c3e0', 'volume_name': 'volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670cf366-f753-42c0-be40-d35ef41a0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670cf366-f753-42c0-be40-d35ef41a0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af41f029-ba32-4d23-8bf0-8f4f93cad704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Volume 445ea8ef-c8a9-4568-b30e-716dc532c3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0', 'volume_size': 1} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-832604200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445ea8ef-c8a9-4568-b30e-716dc532c3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:44:59Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Creating volume 445ea8ef-c8a9-4568-b30e-716dc532c3e0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:44:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:44:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:58 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 1073741824 Sep 06 22:44:58 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bc6ef8ca-6644-4f6c-947a-0bf98ffd363c tempest-GroupSnapshotsTest-1771170664 None] group_snapshot 561ade5b-89f4-4b49-afa9-9054b5e61891: deleted successfully Sep 06 22:44:59 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 1073741824" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:44:59 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 Sep 06 22:44:59 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:44:59 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af41f029-ba32-4d23-8bf0-8f4f93cad704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08f0966-f704-47d1-9676-6fc42f4b3971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:44:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Volume volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 (445ea8ef-c8a9-4568-b30e-716dc532c3e0): created successfully Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08f0966-f704-47d1-9676-6fc42f4b3971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:44:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (76390b9f-bc10-4db0-a14c-eb556866a68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:44:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4d47ad9d-8770-400d-beab-f1e2edef5b7c tempest-VolumesListAdminTestJSON-551759403 None] Created volume successfully. Sep 06 22:45:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3490da-7492-4262-a6be-775b91035e60]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:00 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b Sep 06 22:45:00 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:01 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b" returned: 0 in 0.623s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:01 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b Sep 06 22:45:01 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:01 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0f870983-8e4b-465c-aa93-a14d9c7ece1b" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-0f870983-8e4b-465c-aa93-a14d9c7ece1b" released by "delete_volume" :: held 1.189s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f98ae0-6875-41da-8a84-5e74c1c1e56a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e28e2e0e-fd76-49d2-9b53-86d93ff1af74 req-293ba79d-ee88-4340-9ef8-8fe0ff532487 tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e28e2e0e-fd76-49d2-9b53-86d93ff1af74 req-293ba79d-ee88-4340-9ef8-8fe0ff532487 tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e28e2e0e-fd76-49d2-9b53-86d93ff1af74 req-293ba79d-ee88-4340-9ef8-8fe0ff532487 tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e28e2e0e-fd76-49d2-9b53-86d93ff1af74 req-293ba79d-ee88-4340-9ef8-8fe0ff532487 tempest-TaggedAttachmentsTest-1470021961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-6fa2831b-1252-4f95-ad75-da43f25d0962', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2818316-4800-40b1-9681-76ebb7135e47', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:01 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 Sep 06 22:45:01 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (094e827b-d7b1-4992-884e-5d5a48bda5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78ddade-4c8e-4faf-8a91-2d67582199b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78ddade-4c8e-4faf-8a91-2d67582199b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1384082689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baf1c37-5815-41a7-b043-4582194c982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:02Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e258e32-0e5e-4d32-820a-663fa3cc7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e258e32-0e5e-4d32-820a-663fa3cc7f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0da51e-8a34-4b78-bf91-c0e3d15b868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0da51e-8a34-4b78-bf91-c0e3d15b868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8baf1c37-5815-41a7-b043-4582194c982a', 'volume_name': 'volume-8baf1c37-5815-41a7-b043-4582194c982a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1519f0ab-6406-4200-b3ad-9dd2fd36d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1519f0ab-6406-4200-b3ad-9dd2fd36d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39a6803-73fc-4b1b-bdc1-3b013e48ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Volume 8baf1c37-5815-41a7-b043-4582194c982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8baf1c37-5815-41a7-b043-4582194c982a', 'volume_size': 1} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1384082689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baf1c37-5815-41a7-b043-4582194c982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:02Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Creating volume 8baf1c37-5815-41a7-b043-4582194c982a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:02 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:02 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a 1073741824 Sep 06 22:45:02 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-e28e2e0e-fd76-49d2-9b53-86d93ff1af74 req-293ba79d-ee88-4340-9ef8-8fe0ff532487 tempest-TaggedAttachmentsTest-1470021961 None] attachment_update completed successfully. Sep 06 22:45:02 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" returned: 0 in 0.402s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:02 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0 Sep 06 22:45:02 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:02 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-b0f58da7-76b4-4dfe-a0a1-41ec539e59c0" released by "delete_volume" :: held 0.865s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['a0d72d1c-b454-4c5f-9f2c-10484de37fec'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:02 devstack cinder-volume[87517]: WARNING cinder.quota [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-480144 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-480144, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['bc12a58e-0e5a-4d8b-8136-f2aaf5ef594d', '76f81e7a-5e8a-4962-a545-4fd8100fd8da', '2dbb323a-51ca-4419-9e1b-1b3c9a0acf7a', '3d588cc7-8083-4b42-b88a-4eb0363f3401'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:02 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a 1073741824" returned: 0 in 0.823s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:02 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a Sep 06 22:45:02 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['50f683a1-b476-4c73-b29e-18a73e8799f4', '30e71cfe-f90b-416d-9074-c0b14f645eec', '6d299e2e-d866-4135-bbf8-974b8a9bdc7d', '4f20649f-8228-47ab-82e7-158c7d71ccc1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:03 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:03 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:03 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39a6803-73fc-4b1b-bdc1-3b013e48ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8baf1c37-5815-41a7-b043-4582194c982a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f59b6b-5412-42ee-ada3-c12218df68c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Volume volume-8baf1c37-5815-41a7-b043-4582194c982a (8baf1c37-5815-41a7-b043-4582194c982a): created successfully Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f59b6b-5412-42ee-ada3-c12218df68c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (094e827b-d7b1-4992-884e-5d5a48bda5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-08ea98e1-afef-4543-99a0-96505d4a2ec2 tempest-VolumesListAdminTestJSON-551759403 None] Created volume successfully. Sep 06 22:45:03 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-94fa3eb1-b8da-4ad5-bda0-625e5e418d30 tempest-GroupSnapshotsTest-1771170664 None] Delete group completed successfully. Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5d7c9bc8-7e77-4914-a833-f58e952ed6b9 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-1472181419: creating Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5d7c9bc8-7e77-4914-a833-f58e952ed6b9 tempest-GroupSnapshotsTest-1771170664 None] Group tempest-GroupSnapshotsTest-Group-1472181419: created successfully Sep 06 22:45:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5d7c9bc8-7e77-4914-a833-f58e952ed6b9 tempest-GroupSnapshotsTest-1771170664 None] Create group completed successfully. Sep 06 22:45:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-5bf220a1-e5a6-43b1-a89d-bd11dc58eacf req-0c1fc0a0-e5d3-421e-96a6-cdee3e0dab66 tempest-ServerActionsTestOtherA-759551995 None] Terminate volume connection completed successfully. Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-5bf220a1-e5a6-43b1-a89d-bd11dc58eacf req-0c1fc0a0-e5d3-421e-96a6-cdee3e0dab66 tempest-ServerActionsTestOtherA-759551995 None] Deleting attachment 17cb231e-b11c-4596-9c24-a9e501c59ff5. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (f5cfa8b4-e876-470e-a37b-d115ad8f3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237727dc-757a-485a-b5e9-f27f7d163a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237727dc-757a-485a-b5e9-f27f7d163a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136438196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bc8a7a-0c52-4550-bd58-ad47bb565ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:04Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37760aba-dfa3-49bb-927a-1faec414eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37760aba-dfa3-49bb-927a-1faec414eb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb97b8c-b616-41c2-8049-064b70d34d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb97b8c-b616-41c2-8049-064b70d34d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bc8a7a-0c52-4550-bd58-ad47bb565ad8', 'volume_name': 'volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0891a407-ba53-45e4-87d0-c9e4cb54a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0891a407-ba53-45e4-87d0-c9e4cb54a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde01f2-3d5e-4082-b315-dcfc64a500a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Volume c2bc8a7a-0c52-4550-bd58-ad47bb565ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8', 'volume_size': 1} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136438196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bc8a7a-0c52-4550-bd58-ad47bb565ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35997b8e93b4727aca66291f77fa941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:04Z,use_quota=True,user_id='78453683fe684472ab22efd7fd538932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Creating volume c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:04 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 1073741824 Sep 06 22:45:04 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:05 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 1073741824" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:05 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 Sep 06 22:45:05 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (68cd5602-858e-4b82-b2c6-43f197cc7101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e612d4-624b-4824-bb3a-9a443e92a281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e612d4-624b-4824-bb3a-9a443e92a281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059812482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e176dec7-9be3-4a81-bf86-035159811b0a,host='devstack@QuobyteHD#QuobyteHD',id=c6d173c6-8027-4cfc-a37c-28b20025c2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:05Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fefddfb-8a6c-4779-8cd1-1aa44283334e),volume_type_id=6fefddfb-8a6c-4779-8cd1-1aa44283334e)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069e695f-b72b-49f2-b845-0e289a284e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069e695f-b72b-49f2-b845-0e289a284e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc995d8-ef40-4245-82ae-3459a99b7f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc995d8-ef40-4245-82ae-3459a99b7f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d173c6-8027-4cfc-a37c-28b20025c2bf', 'volume_name': 'volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21804ae4-8b01-45ad-bea1-920e347e88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21804ae4-8b01-45ad-bea1-920e347e88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d7d02e-8d22-4343-a664-a325303e0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Volume c6d173c6-8027-4cfc-a37c-28b20025c2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf', 'volume_size': 1} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:05 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:05 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c513b9ec-133b-4555-9592-00346f3242b0 req-e71ec0cf-eda5-44de-be6e-d9166fcbabb6 tempest-TaggedAttachmentsTest-1470021961 None] Terminate volume connection completed successfully. Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c513b9ec-133b-4555-9592-00346f3242b0 req-e71ec0cf-eda5-44de-be6e-d9166fcbabb6 tempest-TaggedAttachmentsTest-1470021961 None] Deleting attachment b2818316-4800-40b1-9681-76ebb7135e47. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:45:05 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" returned: 0 in 0.468s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e176dec7-9be3-4a81-bf86-035159811b0a,created_at=2026-09-06T20:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059812482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e176dec7-9be3-4a81-bf86-035159811b0a,host='devstack@QuobyteHD#QuobyteHD',id=c6d173c6-8027-4cfc-a37c-28b20025c2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85615c89154b56b21d356180467279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:05Z,use_quota=True,user_id='8c98f7234a11475ba02eb89b8afd0fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fefddfb-8a6c-4779-8cd1-1aa44283334e),volume_type_id=6fefddfb-8a6c-4779-8cd1-1aa44283334e)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Creating volume c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:05 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:05 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf 1073741824 Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde01f2-3d5e-4082-b315-dcfc64a500a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff84daa4-3658-443b-b485-d415c0faddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Volume volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 (c2bc8a7a-0c52-4550-bd58-ad47bb565ad8): created successfully Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff84daa4-3658-443b-b485-d415c0faddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Flow 'volume_create_manager' (f5cfa8b4-e876-470e-a37b-d115ad8f3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc38c252-900e-4fc7-828d-ea10231b9a2c tempest-VolumesListAdminTestJSON-551759403 None] Created volume successfully. Sep 06 22:45:06 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.580s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 8 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:45:06 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf 1073741824" returned: 0 in 0.729s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:06 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf Sep 06 22:45:06 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:07 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf" returned: 0 in 0.619s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d7d02e-8d22-4343-a664-a325303e0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8369261e-2d33-427f-9d0b-0830ecbf3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:07 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Volume volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf (c6d173c6-8027-4cfc-a37c-28b20025c2bf): created successfully Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8369261e-2d33-427f-9d0b-0830ecbf3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Flow 'volume_create_manager' (68cd5602-858e-4b82-b2c6-43f197cc7101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f13618bf-4808-4972-b06e-58b47cb4693a tempest-GroupSnapshotsTest-1771170664 None] Created volume successfully. Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Flow 'volume_create_manager' (7cd75ea5-2651-4461-8bc4-454db8df0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090cab32-d5fb-4bfb-976f-e620722c8740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090cab32-d5fb-4bfb-976f-e620722c8740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68859f5a-70b3-4bdf-8c7f-6a6749f526aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6a36aae57b414d8158e712c693d915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:08Z,use_quota=True,user_id='dcd15a5c947c456897174738dee132c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71fb35c-3f32-4078-bf26-e20d99cd2cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71fb35c-3f32-4078-bf26-e20d99cd2cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a709c8-c870-41fc-9677-54ef9a106839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a709c8-c870-41fc-9677-54ef9a106839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68859f5a-70b3-4bdf-8c7f-6a6749f526aa', 'volume_name': 'volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:08 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa 1073741824 Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac6d360-a396-4c52-ba58-f95b6ea03c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac6d360-a396-4c52-ba58-f95b6ea03c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d968587b-0db8-4b61-8587-c1fbcdf6b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Volume 68859f5a-70b3-4bdf-8c7f-6a6749f526aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa', 'volume_size': 1} Sep 06 22:45:08 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68859f5a-70b3-4bdf-8c7f-6a6749f526aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6a36aae57b414d8158e712c693d915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:08Z,use_quota=True,user_id='dcd15a5c947c456897174738dee132c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Creating volume 68859f5a-70b3-4bdf-8c7f-6a6749f526aa {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:08 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:08 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa 1073741824" returned: 0 in 0.794s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=156,cinder:INSERT=42,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=166,cinder:SELECT=159,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:45:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] GroupSnapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: creating. Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Group snapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 22:45:08 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa Sep 06 22:45:08 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:09 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.293s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d968587b-0db8-4b61-8587-c1fbcdf6b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f2a611-41a6-437d-b1aa-35eb2a5766cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Creating offline snapshot 42d83780-e60a-4779-8e9f-b9ec5007df9f of volume c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:45:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Volume volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa (68859f5a-70b3-4bdf-8c7f-6a6749f526aa): created successfully Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f2a611-41a6-437d-b1aa-35eb2a5766cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Flow 'volume_create_manager' (7cd75ea5-2651-4461-8bc4-454db8df0da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[671742f8-f692-442b-a370-413112b64ca0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-04f7af9e-44c8-4ed2-bdf4-96e70e0f52e5 tempest-VolumesListAdminTestJSON-92932359 None] Created volume successfully. Sep 06 22:45:09 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf Sep 06 22:45:09 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:09 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:09 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f 1G Sep 06 22:45:09 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Acquiring lock "cinder-68859f5a-70b3-4bdf-8c7f-6a6749f526aa-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "cinder-68859f5a-70b3-4bdf-8c7f-6a6749f526aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Acquiring lock "cinder-quobyte-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "cinder-quobyte-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0589541c-f7c1-4622-a43b-f8b347581a16]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:10 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f 1G" returned: 0 in 0.735s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:10 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f Sep 06 22:45:10 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:10 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa Sep 06 22:45:10 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-quobyte-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32623e3-7868-4151-bbfa-25432f8a9a09]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:10 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 Sep 06 22:45:10 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" returned: 0 in 0.595s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f" returned: 0 in 0.583s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa Sep 06 22:45:11 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f Sep 06 22:45:11 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" returned: 0 in 0.681s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8 Sep 06 22:45:11 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "cinder-quobyte-68859f5a-70b3-4bdf-8c7f-6a6749f526aa" released by "delete_volume" :: held 1.149s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:11 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info Sep 06 22:45:11 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Created reservations ['c743af19-20d6-4e96-a507-4eb3b78785e0', '61e3c731-b71b-45a9-95b0-94ae9400f363', '2b07173f-6545-4a41-a30c-14b176b4cec6', 'e81979ba-e349-4ee0-bbce-4d6ad3fc1c7b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:11 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8" released by "delete_volume" :: held 1.168s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:11 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info" returned: 0 in 0.448s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:11 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Created reservations ['4888cc8e-f2ad-4751-90ae-18edc00ae2bc', 'd1709965-170e-4ce3-b7af-1cab4a2e01e0', '3b3801a4-18e0-4215-ab4e-d06be23bb9e7', 'a7522067-ee22-4248-8181-c51e2631091b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:11 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info Sep 06 22:45:11 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:12 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:12 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:12 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Deleted volume successfully. Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ec2e8247-cc68-476f-a1a8-21abcd2fef72 tempest-VolumesListAdminTestJSON-92932359 None] Lock "cinder-68859f5a-70b3-4bdf-8c7f-6a6749f526aa-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:12 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.info" returned: 0 in 0.427s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.127s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:12 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Deleted volume successfully. Sep 06 22:45:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0a145b04-2c09-46b4-aa3c-414456f1e311 tempest-GroupSnapshotsTest-1771170664 None] group_snapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: created successfully Sep 06 22:45:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2920c067-f040-4bce-8c80-769e71aeb94d tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-c2bc8a7a-0c52-4550-bd58-ad47bb565ad8-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-8baf1c37-5815-41a7-b043-4582194c982a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Flow 'volume_create_manager' (8a27a640-7a8b-492c-95c3-bdd0d15957f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143adac3-41e7-4bff-a0c7-e0e741cc7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-8baf1c37-5815-41a7-b043-4582194c982a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143adac3-41e7-4bff-a0c7-e0e741cc7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-981543853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3902ff65-39f9-4703-8fe6-f27c5c213135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fd2d020d6e45ce8d0c1a5271520b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:13Z,use_quota=True,user_id='433037baba47443f966aec4aba6b717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b367334-5bbb-4ba3-b7a6-4abed1a95698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b367334-5bbb-4ba3-b7a6-4abed1a95698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d88fd91-70f2-4eca-923b-c6eadadfa3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-quobyte-8baf1c37-5815-41a7-b043-4582194c982a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-8baf1c37-5815-41a7-b043-4582194c982a" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec1a3d-876f-41d7-89ce-c8b0383750b8]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] group_snapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: deleting Sep 06 22:45:13 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a Sep 06 22:45:13 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] group_snapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-42d83780-e60a-4779-8e9f-b9ec5007df9f" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-42d83780-e60a-4779-8e9f-b9ec5007df9f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Deleting offline snapshot 42d83780-e60a-4779-8e9f-b9ec5007df9f of volume c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] snapshot_file for this snap is: volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8b109-faf3-4ae5-b3de-c698925b9f03]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d88fd91-70f2-4eca-923b-c6eadadfa3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3902ff65-39f9-4703-8fe6-f27c5c213135', 'volume_name': 'volume-3902ff65-39f9-4703-8fe6-f27c5c213135', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b883e86-a964-4ee4-9711-6d5d86dbf5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b883e86-a964-4ee4-9711-6d5d86dbf5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c0cc5f-8917-4125-b907-bafff0927a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Volume 3902ff65-39f9-4703-8fe6-f27c5c213135: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3902ff65-39f9-4703-8fe6-f27c5c213135', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Trying to clone 3902ff65-39f9-4703-8fe6-f27c5c213135 from image 783de45c-ba65-43ef-be94-87e88c8ed95b at location (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:45:13 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f Sep 06 22:45:13 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:13 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:13 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a Sep 06 22:45:13 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:13 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f" returned: 0 in 0.498s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:45:14 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Image download 20.69 MB at 20.69 MB/s Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7826ae5-6123-4db3-a0df-f2ecc3b90fdd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8baf1c37-5815-41a7-b043-4582194c982a" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa9f14-f38d-4af0-b22e-0e277102417e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-8baf1c37-5815-41a7-b043-4582194c982a" released by "delete_volume" :: held 0.944s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:14 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf Sep 06 22:45:14 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Created reservations ['2b71007f-64ed-4c69-828a-d3aa06378edc', 'fa937e6d-d592-4425-a48e-1b7cda7b0d23', '0ec9a912-9f1e-4a07-8b48-166a1167d0be', '131fb526-0fc6-42b5-9edc-796ca751ea9d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:14 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD Sep 06 22:45:14 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:14 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:14 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b is fetched for user 433037baba47443f966aec4aba6b717a. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:45:14 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f Sep 06 22:45:14 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:14 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Deleted volume successfully. Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b747637-a9a1-4267-be71-bb0e19c9d9ef]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fe599749-45c7-4c5d-a10c-4ba162c73bbb tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-8baf1c37-5815-41a7-b043-4582194c982a-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:14 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD Sep 06 22:45:14 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:14 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:14 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f Sep 06 22:45:14 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:15 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-981543853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3902ff65-39f9-4703-8fe6-f27c5c213135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fd2d020d6e45ce8d0c1a5271520b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:13Z,use_quota=True,user_id='433037baba47443f966aec4aba6b717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Creating volume 3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:15 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1073741824 Sep 06 22:45:15 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:15 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf.42d83780-e60a-4779-8e9f-b9ec5007df9f" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-42d83780-e60a-4779-8e9f-b9ec5007df9f" released by "_delete_snapshot" :: held 1.829s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" released by "delete_snapshot" :: held 1.870s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-445ea8ef-c8a9-4568-b30e-716dc532c3e0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-445ea8ef-c8a9-4568-b30e-716dc532c3e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:15 devstack cinder-volume[87517]: WARNING cinder.quota [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2003302344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2003302344, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:15 devstack cinder-volume[87517]: WARNING cinder.quota [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2003302344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2003302344, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "cinder-quobyte-445ea8ef-c8a9-4568-b30e-716dc532c3e0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['debeb014-8ca8-4644-8b64-6063e5196ed5', 'c55b2dfa-1245-43c1-b73b-1a742537add9', 'de1e3648-4b58-4959-ac0f-701a9382afb8', '7a2681fc-b2c0-4a15-88eb-e84b0f13db4e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-445ea8ef-c8a9-4568-b30e-716dc532c3e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a507d7-f0c1-415c-9aa8-c593b89a15a9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47d0c631-6528-4a09-833c-2950752768bd tempest-GroupSnapshotsTest-1771170664 None] group_snapshot d46c9b5e-3fee-44f5-bfae-ebac72f46d06: deleted successfully Sep 06 22:45:15 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1073741824" returned: 0 in 0.571s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:15 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 Sep 06 22:45:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:15 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:15 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 Sep 06 22:45:15 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:15 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:16 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Attempting download of 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 3902ff65-39f9-4703-8fe6-f27c5c213135. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:45:16 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0 Sep 06 22:45:16 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b489ec-ec34-45c9-83dc-52ba84f5a04b]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[29876ad0-e01f-410c-a4ac-115a2aa8d9b1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq Sep 06 22:45:16 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-445ea8ef-c8a9-4568-b30e-716dc532c3e0" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "cinder-6fa2831b-1252-4f95-ad75-da43f25d0962-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-quobyte-445ea8ef-c8a9-4568-b30e-716dc532c3e0" released by "delete_volume" :: held 0.945s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:16 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf Sep 06 22:45:16 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "cinder-6fa2831b-1252-4f95-ad75-da43f25d0962-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "cinder-quobyte-6fa2831b-1252-4f95-ad75-da43f25d0962" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Created reservations ['9d017661-1771-4f83-a6d8-515043e7897a', '1f03d987-4e79-452e-bed0-f63fb3b66434', '765068f9-0927-45aa-a285-e8cd6db33800', '0b4d7e11-b828-4ab8-95e7-48954977b73d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "cinder-quobyte-6fa2831b-1252-4f95-ad75-da43f25d0962" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c672c29-eec6-4fef-9017-c209ed1f1a1c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:16 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 Sep 06 22:45:16 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq Sep 06 22:45:16 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf Sep 06 22:45:16 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Deleted volume successfully. Sep 06 22:45:16 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:16 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq" returned: 1 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_bmw_m7pq' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2bf6b6f9-ce4a-4b0e-8000-736fe9d7654b tempest-VolumesListAdminTestJSON-551759403 None] Lock "cinder-445ea8ef-c8a9-4568-b30e-716dc532c3e0-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:16 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962 Sep 06 22:45:16 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e675536-c12b-4cf7-affb-29000550d585]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:17 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c6d173c6-8027-4cfc-a37c-28b20025c2bf" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Lock "cinder-quobyte-c6d173c6-8027-4cfc-a37c-28b20025c2bf" released by "delete_volume" :: held 0.863s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:17 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD Sep 06 22:45:17 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['c958ee19-88df-40b2-b2fb-2aff8b9b66cd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:17 devstack cinder-volume[87517]: WARNING cinder.quota [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2003302344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2003302344, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Created reservations ['8b91c6d3-d68e-4dc5-b9aa-b2cdc206891e', '704ea3e3-e311-47cb-b5de-4ba808a38d2b', '560481da-c329-4c66-beb5-14b6acc88b6f', 'bb0cead0-4346-4f23-a8b3-077404602ff0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:17 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6fa2831b-1252-4f95-ad75-da43f25d0962" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "cinder-quobyte-6fa2831b-1252-4f95-ad75-da43f25d0962" released by "delete_volume" :: held 0.735s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:17 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:17 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:17 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Created reservations ['fa3b2906-38c6-43b5-b5b9-ef3bce0054f9', '116cb16c-c588-4ed9-880d-21b433b2c4d9', '28b9f2e1-9740-49e8-815c-b2d0fbec0f0c', '875808e6-44ac-4c99-ad0f-ffdc3edc2177'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] 783de45c-ba65-43ef-be94-87e88c8ed95b was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:17 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 Sep 06 22:45:17 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:17 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:17 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:17 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ad45b47c-5a92-4802-a204-93c296c92e61 tempest-GroupSnapshotsTest-1771170664 None] Delete group completed successfully. Sep 06 22:45:17 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Deleted volume successfully. Sep 06 22:45:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8a651e2-1e3f-4292-b623-2533db4c611d tempest-TaggedAttachmentsTest-1470021961 None] Lock "cinder-6fa2831b-1252-4f95-ad75-da43f25d0962-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:19 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135" returned: 0 in 2.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:19 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_di8rk127devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:45:19 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Converted 112.00 MB image at 48.18 MB/s Sep 06 22:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:19 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1G Sep 06 22:45:19 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:20 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 1G" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Downloaded image 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 3902ff65-39f9-4703-8fe6-f27c5c213135 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b for user 433037baba47443f966aec4aba6b717a is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Marking volume 3902ff65-39f9-4703-8fe6-f27c5c213135 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Copying metadata from image 783de45c-ba65-43ef-be94-87e88c8ed95b to 3902ff65-39f9-4703-8fe6-f27c5c213135. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Creating volume glance metadata for volume 3902ff65-39f9-4703-8fe6-f27c5c213135 backed by image 783de45c-ba65-43ef-be94-87e88c8ed95b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c0cc5f-8917-4125-b907-bafff0927a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3902ff65-39f9-4703-8fe6-f27c5c213135', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084a62c9-c27b-407d-a02a-ad5f8a897f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Volume volume-3902ff65-39f9-4703-8fe6-f27c5c213135 (3902ff65-39f9-4703-8fe6-f27c5c213135): created successfully Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084a62c9-c27b-407d-a02a-ad5f8a897f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Flow 'volume_create_manager' (8a27a640-7a8b-492c-95c3-bdd0d15957f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cdb4b6ca-0cc9-45fb-bcac-24e5d2ce2909 tempest-ServerActionsTestOtherA-759551995 None] Created volume successfully. Sep 06 22:45:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-76d69f71-fdaf-4b78-90db-c2d735f9bc06 req-f0326981-af42-419c-a769-803d9a412ebd tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-76d69f71-fdaf-4b78-90db-c2d735f9bc06 req-f0326981-af42-419c-a769-803d9a412ebd tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-76d69f71-fdaf-4b78-90db-c2d735f9bc06 req-f0326981-af42-419c-a769-803d9a412ebd tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-76d69f71-fdaf-4b78-90db-c2d735f9bc06 req-f0326981-af42-419c-a769-803d9a412ebd tempest-ServerActionsTestOtherA-759551995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-3902ff65-39f9-4703-8fe6-f27c5c213135', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddb06c25-8f84-4870-aee6-ace5e7c4b1d1', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:45:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-76d69f71-fdaf-4b78-90db-c2d735f9bc06 req-f0326981-af42-419c-a769-803d9a412ebd tempest-ServerActionsTestOtherA-759551995 None] attachment_update completed successfully. Sep 06 22:45:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-68b0ba98-600a-4147-a24e-da5aca9476e7 tempest-GroupSnapshotsV319Test-1802443663 None] Group tempest-GroupSnapshotsV319Test-Group-2024334387: creating Sep 06 22:45:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-68b0ba98-600a-4147-a24e-da5aca9476e7 tempest-GroupSnapshotsV319Test-1802443663 None] Group tempest-GroupSnapshotsV319Test-Group-2024334387: created successfully Sep 06 22:45:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-68b0ba98-600a-4147-a24e-da5aca9476e7 tempest-GroupSnapshotsV319Test-1802443663 None] Create group completed successfully. Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Flow 'volume_create_manager' (02a223b8-e5ce-48ab-8584-a742e89a88d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb30e06-1fd5-4036-8301-5beeb976584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb30e06-1fd5-4036-8301-5beeb976584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126847790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2052882e-b4e9-4c61-8b87-c7105de05c5d,host='devstack@QuobyteHD#QuobyteHD',id=aae2f929-08dd-4c65-8ab2-17596d45c50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a67697e7ea43379eddaa5ac8cc18a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:29Z,use_quota=True,user_id='56bae452654441a293458763d7348ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54def82a-771c-4add-91f9-7e10118f230a),volume_type_id=54def82a-771c-4add-91f9-7e10118f230a)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea0640-554c-4319-927d-7da2fb27d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea0640-554c-4319-927d-7da2fb27d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f59e7fb-56f4-4b67-9358-7c3bc7b7c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f59e7fb-56f4-4b67-9358-7c3bc7b7c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae2f929-08dd-4c65-8ab2-17596d45c50e', 'volume_name': 'volume-aae2f929-08dd-4c65-8ab2-17596d45c50e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b273f6-715c-4661-9f0e-82bdd382beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b273f6-715c-4661-9f0e-82bdd382beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19296ad-adf1-4c0f-8415-5e2698eed19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Volume aae2f929-08dd-4c65-8ab2-17596d45c50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae2f929-08dd-4c65-8ab2-17596d45c50e', 'volume_size': 1} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2052882e-b4e9-4c61-8b87-c7105de05c5d,created_at=2026-09-06T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126847790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2052882e-b4e9-4c61-8b87-c7105de05c5d,host='devstack@QuobyteHD#QuobyteHD',id=aae2f929-08dd-4c65-8ab2-17596d45c50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a67697e7ea43379eddaa5ac8cc18a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:29Z,use_quota=True,user_id='56bae452654441a293458763d7348ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54def82a-771c-4add-91f9-7e10118f230a),volume_type_id=54def82a-771c-4add-91f9-7e10118f230a)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Creating volume aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:29 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e 1073741824 Sep 06 22:45:29 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:30 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e 1073741824" returned: 0 in 0.811s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:30 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e Sep 06 22:45:30 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:31 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e" returned: 0 in 0.423s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19296ad-adf1-4c0f-8415-5e2698eed19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae2f929-08dd-4c65-8ab2-17596d45c50e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e830dfd-b444-4a74-a297-3b633ba760e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Volume volume-aae2f929-08dd-4c65-8ab2-17596d45c50e (aae2f929-08dd-4c65-8ab2-17596d45c50e): created successfully Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e830dfd-b444-4a74-a297-3b633ba760e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Flow 'volume_create_manager' (02a223b8-e5ce-48ab-8584-a742e89a88d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-695e025a-e23e-48f1-b587-922759cb32d8 tempest-GroupSnapshotsV319Test-1802443663 None] Created volume successfully. Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Flow 'volume_create_manager' (b82fd94a-8c54-4d88-abfc-fce8b096b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582f32ae-0461-496b-8e72-abe0e86df6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582f32ae-0461-496b-8e72-abe0e86df6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-968905793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514039b3-b211-447e-ba3f-96c076c0818a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b619158f998248559b06fe62b79408f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:32Z,use_quota=True,user_id='f92bc0362d5f43528f655dadb422f5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7f4826-02d9-43cd-add8-d2e7c2ee54cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7f4826-02d9-43cd-add8-d2e7c2ee54cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a28ee6-428d-4e23-abb2-c6b6363b2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a28ee6-428d-4e23-abb2-c6b6363b2f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514039b3-b211-447e-ba3f-96c076c0818a', 'volume_name': 'volume-514039b3-b211-447e-ba3f-96c076c0818a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c22c8d1-d522-4dd5-ad1c-a51cd3fe0df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c22c8d1-d522-4dd5-ad1c-a51cd3fe0df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1de5e9-7ce3-4445-bd45-6e63274fddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Volume 514039b3-b211-447e-ba3f-96c076c0818a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514039b3-b211-447e-ba3f-96c076c0818a', 'volume_size': 1} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-968905793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514039b3-b211-447e-ba3f-96c076c0818a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b619158f998248559b06fe62b79408f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:32Z,use_quota=True,user_id='f92bc0362d5f43528f655dadb422f5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Creating volume 514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:32 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:32 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a 1073741824 Sep 06 22:45:32 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] GroupSnapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: creating. Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Group snapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 22:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:33 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a 1073741824" returned: 0 in 0.688s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:33 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a Sep 06 22:45:33 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:33 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1de5e9-7ce3-4445-bd45-6e63274fddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514039b3-b211-447e-ba3f-96c076c0818a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd998231-4d7a-44a9-acca-9f9359d2d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Creating offline snapshot f22dadc4-6d6b-427e-b08c-7fde7db03958 of volume aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:45:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Volume volume-514039b3-b211-447e-ba3f-96c076c0818a (514039b3-b211-447e-ba3f-96c076c0818a): created successfully Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd998231-4d7a-44a9-acca-9f9359d2d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Flow 'volume_create_manager' (b82fd94a-8c54-4d88-abfc-fce8b096b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57ef6b-7c35-454b-a18a-cea704a99e51]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-31d1a32f-3f67-4a65-88f9-76b665d9076d tempest-SnapshotMetadataTestJSON-544104936 None] Created volume successfully. Sep 06 22:45:33 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e Sep 06 22:45:33 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:34 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e" returned: 0 in 0.574s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:34 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 1G Sep 06 22:45:34 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:34 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 1G" returned: 0 in 0.620s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2f929-08dd-4c65-8ab2-17596d45c50e -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:34 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2f929-08dd-4c65-8ab2-17596d45c50e -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 Sep 06 22:45:34 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:35 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2f929-08dd-4c65-8ab2-17596d45c50e -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:35 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:35 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 Sep 06 22:45:35 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:35 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958" returned: 0 in 0.540s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:35 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info Sep 06 22:45:35 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:36 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:36 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info Sep 06 22:45:36 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:36 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.info" returned: 0 in 0.452s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.180s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.116s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Creating offline snapshot d36c438f-cc66-406a-b22b-ae91e2ca4115 of volume 514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b4365-e2e1-45d3-9e59-c0354e4e1a7a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f119929d-4514-4864-b341-351355a68e8f tempest-GroupSnapshotsV319Test-1802443663 None] group_snapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: created successfully Sep 06 22:45:37 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a Sep 06 22:45:37 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:37 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a" returned: 0 in 0.914s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:37 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 1G Sep 06 22:45:37 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] group_snapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: deleting Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] group_snapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "cinder-quobyte-f22dadc4-6d6b-427e-b08c-7fde7db03958" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-f22dadc4-6d6b-427e-b08c-7fde7db03958" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Deleting offline snapshot f22dadc4-6d6b-427e-b08c-7fde7db03958 of volume aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] snapshot_file for this snap is: volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e7ece-104b-46ce-9b7c-2e46e7b290d7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:38 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 Sep 06 22:45:38 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:38 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 1G" returned: 0 in 0.832s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514039b3-b211-447e-ba3f-96c076c0818a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:38 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514039b3-b211-447e-ba3f-96c076c0818a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 Sep 06 22:45:38 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:39 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958" returned: 0 in 0.768s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae2f929-08dd-4c65-8ab2-17596d45c50e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94f154-f96a-49e4-92d2-b411498a14a1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:39 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e Sep 06 22:45:39 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:39 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514039b3-b211-447e-ba3f-96c076c0818a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115" returned: 0 in 0.701s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:39 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 is being set with open permissions: ugo+rw Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:39 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 Sep 06 22:45:39 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:39 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:39 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e" returned: 0 in 0.647s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:39 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 Sep 06 22:45:39 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:39 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info Sep 06 22:45:39 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:40 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:40 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info is being set with open permissions: ugo+rw Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:40 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info Sep 06 22:45:40 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:40 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:40 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958 Sep 06 22:45:40 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:40 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.info" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1c09d5d9-8365-48e3-b0b9-f3902ccb5ac0 tempest-SnapshotMetadataTestJSON-544104936 None] Create snapshot completed successfully Sep 06 22:45:40 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e.f22dadc4-6d6b-427e-b08c-7fde7db03958" returned: 0 in 0.468s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-f22dadc4-6d6b-427e-b08c-7fde7db03958" released by "_delete_snapshot" :: held 2.692s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" released by "delete_snapshot" :: held 2.745s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:40 devstack cinder-volume[87517]: WARNING cinder.quota [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1326021859 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1326021859, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:40 devstack cinder-volume[87517]: WARNING cinder.quota [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1326021859 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1326021859, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] Created reservations ['de3a935f-fe3d-4aec-b2af-e3b9ced48df1', '358d1bb0-234c-4ddb-8a7b-91871e6dea83', 'd6da2578-905a-48c2-91f0-9342436359a1', '4252dbb2-4f1f-4fca-8590-6730bba5cb72'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2a5b2647-f530-43e0-9142-7c987c544985 tempest-GroupSnapshotsV319Test-1802443663 None] group_snapshot 372521a9-f0ff-4366-a3c2-11ed4814a828: deleted successfully Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e4ff99-d201-4b64-95bc-2f38d9ab9131]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:42 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e Sep 06 22:45:42 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:42 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e" returned: 0 in 0.655s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:42 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e Sep 06 22:45:42 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "cinder-d36c438f-cc66-406a-b22b-ae91e2ca4115-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-d36c438f-cc66-406a-b22b-ae91e2ca4115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "cinder-quobyte-d36c438f-cc66-406a-b22b-ae91e2ca4115" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-d36c438f-cc66-406a-b22b-ae91e2ca4115" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Deleting offline snapshot d36c438f-cc66-406a-b22b-ae91e2ca4115 of volume 514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] snapshot_file for this snap is: volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb0437-d400-44db-8094-ea0ae3e6bb8c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:43 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aae2f929-08dd-4c65-8ab2-17596d45c50e" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Lock "cinder-quobyte-aae2f929-08dd-4c65-8ab2-17596d45c50e" released by "delete_volume" :: held 1.129s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:43 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 Sep 06 22:45:43 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Created reservations ['2fcac73e-5c8b-48f4-95ac-35fffdd89959'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:43 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1326021859 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1326021859, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Created reservations ['cbfcec94-9a85-4a89-bdb9-70b874d94bb1', '22288a52-e4d7-49a6-80d4-8067c0c273a6', '95b14f2a-4de9-4d20-8368-5851fbfb8b99', '1a068ffb-b8dc-41c3-b49a-58ad7271f038'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:43 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115" returned: 0 in 0.579s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514039b3-b211-447e-ba3f-96c076c0818a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c2497-54cd-4475-b983-0d810a5b3f63]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:43 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:43 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:44 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a Sep 06 22:45:44 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:44 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bd4b327a-6164-48bf-b0ad-94b2cc49190e tempest-GroupSnapshotsV319Test-1802443663 None] Delete group completed successfully. Sep 06 22:45:44 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a" returned: 0 in 0.731s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:44 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 Sep 06 22:45:44 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-920e69ea-6a7f-4ddc-9e8c-8de2bdbf57b2 tempest-ServerActionsTestOtherA-759551995 None] Terminate volume connection completed successfully. Sep 06 22:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-920e69ea-6a7f-4ddc-9e8c-8de2bdbf57b2 tempest-ServerActionsTestOtherA-759551995 None] Deleting attachment ddb06c25-8f84-4870-aee6-ace5e7c4b1d1. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:45:45 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115" returned: 0 in 0.557s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:45 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115 Sep 06 22:45:45 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:45 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a.d36c438f-cc66-406a-b22b-ae91e2ca4115" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-d36c438f-cc66-406a-b22b-ae91e2ca4115" released by "_delete_snapshot" :: held 2.445s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" released by "delete_snapshot" :: held 2.497s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Created reservations ['4082094a-afe7-482f-aad6-dc01dbad6a83', 'b06084b6-39b1-4e38-8267-127a7a253c9a', 'e2f8ff21-c2bd-4647-998f-fcfe68b66055', 'afd053e8-e9fd-42fd-8879-0eb79e077a11'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Delete snapshot completed successfully. Sep 06 22:45:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d593fec6-7c6a-40a5-a96f-3b56d8a6304c tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-d36c438f-cc66-406a-b22b-ae91e2ca4115-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "cinder-514039b3-b211-447e-ba3f-96c076c0818a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-514039b3-b211-447e-ba3f-96c076c0818a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55f5ba-3332-4f0d-801a-b602c83ef3a6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:46 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a Sep 06 22:45:46 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:47 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:47 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a Sep 06 22:45:47 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:47 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-514039b3-b211-447e-ba3f-96c076c0818a" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-quobyte-514039b3-b211-447e-ba3f-96c076c0818a" released by "delete_volume" :: held 0.765s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Created reservations ['b26dc7fa-5744-41fe-a1aa-494bf4c11f6a', '4755d040-1983-4bf3-a6e9-47e5f21c6120', '4d55ff10-f758-4c0a-b640-5c290fdb8a4d', '1a83b6e4-a103-48d0-9ef2-ace92b1b2075'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:47 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:45:47 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:47 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:45:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Deleted volume successfully. Sep 06 22:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5b8941d-8157-4563-ade0-b1a4819cb083 tempest-SnapshotMetadataTestJSON-544104936 None] Lock "cinder-514039b3-b211-447e-ba3f-96c076c0818a-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:45:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-3396c47c-7c43-48bb-be9b-e99cf99fbe6a tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-3396c47c-7c43-48bb-be9b-e99cf99fbe6a tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-3396c47c-7c43-48bb-be9b-e99cf99fbe6a tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-3396c47c-7c43-48bb-be9b-e99cf99fbe6a tempest-ServerActionsTestOtherA-759551995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-3902ff65-39f9-4703-8fe6-f27c5c213135', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59bbe3db-dbf5-401b-94f6-59937259b387', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:45:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-54bbba42-cd84-4442-a2ec-6f7ac5cc6dcf req-3396c47c-7c43-48bb-be9b-e99cf99fbe6a tempest-ServerActionsTestOtherA-759551995 None] attachment_update completed successfully. Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (03076888-846f-403c-a08f-f7d467a0c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424036c1-c83a-4497-92ca-e797a5bd2e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424036c1-c83a-4497-92ca-e797a5bd2e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1393278819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f59dc-6ebb-432b-8e0e-5e55c154a87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00366964d1e4597a2d119dc9e3a582d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:55Z,use_quota=True,user_id='dda704c4f4554018a80673b6c4a7e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb9e125-ff8c-4b12-88fb-ed7a84d7ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb9e125-ff8c-4b12-88fb-ed7a84d7ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797d1001-3202-4b55-bf73-6bf27a4b2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797d1001-3202-4b55-bf73-6bf27a4b2a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9f59dc-6ebb-432b-8e0e-5e55c154a87a', 'volume_name': 'volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff7213f-ae36-4827-b3dc-6288d41b712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff7213f-ae36-4827-b3dc-6288d41b712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f62a7-e851-4d13-bd2a-fdc8e3fd7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a', 'volume_size': 1} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1393278819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f59dc-6ebb-432b-8e0e-5e55c154a87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00366964d1e4597a2d119dc9e3a582d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:45:55Z,use_quota=True,user_id='dda704c4f4554018a80673b6c4a7e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Creating volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:45:55 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:55 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a 1073741824 Sep 06 22:45:55 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:56 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a 1073741824" returned: 0 in 1.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:57 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:45:57 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:45:57 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 0.505s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f62a7-e851-4d13-bd2a-fdc8e3fd7771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a053100-d848-4493-a075-49e63c7ffd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:45:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Volume volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a (bd9f59dc-6ebb-432b-8e0e-5e55c154a87a): created successfully Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a053100-d848-4493-a075-49e63c7ffd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:45:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (03076888-846f-403c-a08f-f7d467a0c78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:45:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91a5fcea-f52b-4611-8910-4eeb871ce34d tempest-VolumesDeleteCascade-783810103 None] Created volume successfully. Sep 06 22:45:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:45:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:45:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Creating offline snapshot 9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 of volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:45:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aee2fe-0df1-4e87-afdd-c7e68c3c8a61]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:45:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:45:59 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:45:59 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:00 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 1.084s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:00 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 1G Sep 06 22:46:00 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 1G" returned: 0 in 1.130s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:01 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:01 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:01 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:02 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.637s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 is being set with open permissions: ugo+rw Sep 06 22:46:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:02 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:02 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:02 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:02 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info Sep 06 22:46:02 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:03 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info" returned: 0 in 0.595s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info is being set with open permissions: ugo+rw Sep 06 22:46:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:03 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info Sep 06 22:46:03 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:03 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.info" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.467s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7face576-6423-4785-8153-8eb4c5352c0a tempest-VolumesDeleteCascade-783810103 None] Create snapshot completed successfully Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Creating offline snapshot d5823766-596b-4260-aff5-d96e2cea339e of volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d4a557-795b-4257-aec4-89bf05e70f01]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:05 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:05 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:05 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:05 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:06 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.961s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:06 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e 1G Sep 06 22:46:06 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:06 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.724s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:46:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:46:07 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e 1G" returned: 0 in 0.887s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:07 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:07 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:07 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 0.607s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e is being set with open permissions: ugo+rw Sep 06 22:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:07 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:07 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:08 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ece27d77-44a4-4739-bbd3-b71cac917663 tempest-VolumesDeleteCascade-783810103 None] Create snapshot completed successfully Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Performing cascade delete. {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Deleting offline snapshot 9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 of volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] snapshot_file for this snap is: volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff8e09-0b3f-4546-b532-7f74737109fa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:09 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:09 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:09 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.785s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[44785c78-756c-46d4-a876-725ba76adebd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:09 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:46:09 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:10 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 1.153s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b304ce90-64ad-4b2a-8464-c095b500f685]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:11 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:11 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:12 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 1.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c67235e-c516-45bf-a9ac-43f4970b5873]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:12 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:12 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:12 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.569s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748305b-2df6-424a-a9a5-503e7247b917]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:13 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:46:13 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:13 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 0.778s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:13 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:13 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:14 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.663s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:14 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7 Sep 06 22:46:14 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:15 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" returned: 0 in 0.752s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e -F qcow2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:15 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e -F qcow2 Sep 06 22:46:15 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:15 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e -F qcow2" returned: 0 in 0.890s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7" released by "_delete_snapshot" :: held 7.281s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" released by "delete_snapshot" :: held 7.330s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=131,cinder:INSERT=40,cinder:UPDATE=127,cinder:DELETE=6 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=105,cinder:SELECT=113,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Created reservations ['2cceb418-baa5-4136-aa27-ebd031284d55', '1a9ba2cf-90ef-4b57-9d3c-7c8ab783b4b0', 'd3566058-7285-446f-97cb-21e3560a67c2', '2226b9b8-b4ca-42dd-826e-c19aefd5580b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Delete snapshot completed successfully. Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-9b7b0f29-a5ac-41d1-b27f-3114acfd36f7-delete_snapshot" released by "delete_snapshot" :: held 7.659s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-d5823766-596b-4260-aff5-d96e2cea339e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-d5823766-596b-4260-aff5-d96e2cea339e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-d5823766-596b-4260-aff5-d96e2cea339e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-d5823766-596b-4260-aff5-d96e2cea339e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Deleting offline snapshot d5823766-596b-4260-aff5-d96e2cea339e of volume bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] snapshot_file for this snap is: volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025685a-79f1-43d9-a096-a1cfbf804f49]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:16 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:16 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:17 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 0.664s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b94b8e-53b6-4fe1-8c78-9b4b60eebaad]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:17 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:46:17 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:17 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 0.689s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:17 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:17 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:18 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:18 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e Sep 06 22:46:18 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:18 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a.d5823766-596b-4260-aff5-d96e2cea339e" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-d5823766-596b-4260-aff5-d96e2cea339e" released by "_delete_snapshot" :: held 2.262s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" released by "delete_snapshot" :: held 2.295s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Created reservations ['5882a975-7863-448f-b9ad-c7c3fe543cc3', '3b1f38fa-329a-41bd-82ff-61d70124593c', '60524db1-b68a-410d-a457-905f7f1f1292', '6073c6ec-2caf-4298-bcb8-3b4380a6f899'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Delete snapshot completed successfully. Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-d5823766-596b-4260-aff5-d96e2cea339e-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Snapshots deleted, issuing volume delete {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ab285-93d1-4693-b603-b7434146de5b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:19 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:46:19 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:19 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 0.542s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:19 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a Sep 06 22:46:19 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:19 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a" released by "delete_volume" :: held 0.934s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Created reservations ['6762dfae-2eb8-444c-bf78-73b349f369fa', '95e0106f-4541-433b-b02d-2c89cf1059bc', 'c54eec10-2a3c-4f19-b742-c1648d70f715', '8bacc8bb-8eac-41ea-85fb-84cf62db080e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:20 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:20 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:20 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.415s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Deleted volume successfully. Sep 06 22:46:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3a9b0de3-107e-40cd-9477-6033f2c0aa25 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-bd9f59dc-6ebb-432b-8e0e-5e55c154a87a-delete_volume" released by "delete_volume" :: held 11.888s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (026d7e18-855b-414e-b019-d432d1eb16f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34ab565-f5d3-4611-946b-10652039138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34ab565-f5d3-4611-946b-10652039138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-989317750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798de8e0-d280-42a8-8e97-ff3ab3208288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00366964d1e4597a2d119dc9e3a582d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:21Z,use_quota=True,user_id='dda704c4f4554018a80673b6c4a7e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ccccb7-dbb0-4a0b-bc8a-fd4c9959046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ccccb7-dbb0-4a0b-bc8a-fd4c9959046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0db466d-101a-4890-a882-f2a243634dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0db466d-101a-4890-a882-f2a243634dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798de8e0-d280-42a8-8e97-ff3ab3208288', 'volume_name': 'volume-798de8e0-d280-42a8-8e97-ff3ab3208288', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcb465f-efa3-4592-8e9f-914941239ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcb465f-efa3-4592-8e9f-914941239ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12381f15-2b6a-4b7b-a517-f0eb2e2b518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Volume 798de8e0-d280-42a8-8e97-ff3ab3208288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798de8e0-d280-42a8-8e97-ff3ab3208288', 'volume_size': 1} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-989317750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798de8e0-d280-42a8-8e97-ff3ab3208288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00366964d1e4597a2d119dc9e3a582d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:21Z,use_quota=True,user_id='dda704c4f4554018a80673b6c4a7e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Creating volume 798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:46:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:21 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 1073741824 Sep 06 22:46:21 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:21 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 1073741824" returned: 0 in 0.573s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:22 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:22 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:22 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12381f15-2b6a-4b7b-a517-f0eb2e2b518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798de8e0-d280-42a8-8e97-ff3ab3208288', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d22a5d-3dd0-477c-b7fa-b93b20254675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Volume volume-798de8e0-d280-42a8-8e97-ff3ab3208288 (798de8e0-d280-42a8-8e97-ff3ab3208288): created successfully Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d22a5d-3dd0-477c-b7fa-b93b20254675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (026d7e18-855b-414e-b019-d432d1eb16f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6da18190-c94a-4bdf-9708-b413977c09ca tempest-VolumesDeleteCascade-783810103 None] Created volume successfully. Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Flow 'volume_create_manager' (59115270-034f-462f-bcea-7580b87d60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66235682-c0ee-46eb-9b5e-6d78c1a4dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66235682-c0ee-46eb-9b5e-6d78c1a4dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-600581692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284ec45-1e47-4a57-b0b4-431ae7e191b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddae55c84f947b486e48d588093d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:23Z,use_quota=True,user_id='79f29eee43b14f0d9cb555d7872b9573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a0c668-b84a-4a9c-8a2b-421de007c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a0c668-b84a-4a9c-8a2b-421de007c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb01188e-3a49-488a-a4f9-8df70949f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb01188e-3a49-488a-a4f9-8df70949f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd284ec45-1e47-4a57-b0b4-431ae7e191b8', 'volume_name': 'volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc662a7e-9a3a-49bb-9cc1-8f8552eabef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc662a7e-9a3a-49bb-9cc1-8f8552eabef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1476eee0-6b65-4d87-a303-77b33be527be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Volume d284ec45-1e47-4a57-b0b4-431ae7e191b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8', 'volume_size': 1} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-600581692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284ec45-1e47-4a57-b0b4-431ae7e191b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddae55c84f947b486e48d588093d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:23Z,use_quota=True,user_id='79f29eee43b14f0d9cb555d7872b9573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Creating volume d284ec45-1e47-4a57-b0b4-431ae7e191b8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:23 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 1073741824 Sep 06 22:46:23 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:23 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 1073741824" returned: 0 in 0.530s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:23 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 Sep 06 22:46:23 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:24 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.466s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1476eee0-6b65-4d87-a303-77b33be527be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b1bb25-f2b5-4b70-95dc-9eb889f09987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Creating offline snapshot b5432e04-5366-4c6e-8bd4-bd234d9af8b5 of volume 798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:46:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Volume volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 (d284ec45-1e47-4a57-b0b4-431ae7e191b8): created successfully Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b1bb25-f2b5-4b70-95dc-9eb889f09987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Flow 'volume_create_manager' (59115270-034f-462f-bcea-7580b87d60c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72f239-a52d-43f0-ae2b-41d2acf60efa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-947246f8-d8f2-493b-9d23-e7a5ab829f77 tempest-ServersNegativeTestJSON-1258183772 None] Created volume successfully. Sep 06 22:46:24 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:24 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:24 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.540s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:24 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 1G Sep 06 22:46:24 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:25 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 1G" returned: 0 in 0.517s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798de8e0-d280-42a8-8e97-ff3ab3208288 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:25 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798de8e0-d280-42a8-8e97-ff3ab3208288 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:25 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:25 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798de8e0-d280-42a8-8e97-ff3ab3208288 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:25 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 is being set with open permissions: ugo+rw Sep 06 22:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:25 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:25 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:25 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.385s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:26 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info Sep 06 22:46:26 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:26 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:26 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info is being set with open permissions: ugo+rw Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:26 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info Sep 06 22:46:26 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:26 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.info" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-43a187f0-9f68-46cd-a1b8-6d50798b6df9 tempest-VolumesDeleteCascade-783810103 None] Create snapshot completed successfully Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Flow 'volume_create_manager' (6f0afb2b-3aed-4702-ac4b-2b61e8665d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae8b646-7d8c-4a24-8c2b-7efc8173cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae8b646-7d8c-4a24-8c2b-7efc8173cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2128980269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cea4d3-d315-4194-aef1-62602838099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddae55c84f947b486e48d588093d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:27Z,use_quota=True,user_id='79f29eee43b14f0d9cb555d7872b9573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f90a93c-4337-4cdb-aa43-c47b593781eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f90a93c-4337-4cdb-aa43-c47b593781eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8055deba-44df-442c-b887-e7d456ff5658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8055deba-44df-442c-b887-e7d456ff5658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cea4d3-d315-4194-aef1-62602838099a', 'volume_name': 'volume-b8cea4d3-d315-4194-aef1-62602838099a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892e9541-581f-45db-86e3-be3c71d679ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892e9541-581f-45db-86e3-be3c71d679ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1877555-144a-4fd5-92ba-67949615f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Volume b8cea4d3-d315-4194-aef1-62602838099a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cea4d3-d315-4194-aef1-62602838099a', 'volume_size': 1} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2128980269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cea4d3-d315-4194-aef1-62602838099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddae55c84f947b486e48d588093d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:27Z,use_quota=True,user_id='79f29eee43b14f0d9cb555d7872b9573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Creating volume b8cea4d3-d315-4194-aef1-62602838099a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:26 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a 1073741824 Sep 06 22:46:26 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:27 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a 1073741824" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (296fc3ee-3304-460f-9cbd-637676c3332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e89185-d6cf-4ab4-9369-127420baeae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e89185-d6cf-4ab4-9369-127420baeae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1283839877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31767da9-f1ab-4749-9290-3f03eb474591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00366964d1e4597a2d119dc9e3a582d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5432e04-5366-4c6e-8bd4-bd234d9af8b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:27Z,use_quota=True,user_id='dda704c4f4554018a80673b6c4a7e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b265a-6586-46e2-aa9b-3825064f72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b265a-6586-46e2-aa9b-3825064f72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e7164-22ba-4b70-abe0-1f9e7e476368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e7164-22ba-4b70-abe0-1f9e7e476368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31767da9-f1ab-4749-9290-3f03eb474591', 'volume_name': 'volume-31767da9-f1ab-4749-9290-3f03eb474591', 'volume_size': 1, 'snapshot_id': 'b5432e04-5366-4c6e-8bd4-bd234d9af8b5'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36cd662-75b1-492a-ad27-d490b180f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36cd662-75b1-492a-ad27-d490b180f190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd2b9e-7a8d-4988-ba38-86850ec0654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Volume 31767da9-f1ab-4749-9290-3f03eb474591: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31767da9-f1ab-4749-9290-3f03eb474591', 'volume_size': 1, 'snapshot_id': 'b5432e04-5366-4c6e-8bd4-bd234d9af8b5'} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:27 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a Sep 06 22:46:27 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:27 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.273s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-31767da9-f1ab-4749-9290-3f03eb474591" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1877555-144a-4fd5-92ba-67949615f82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cea4d3-d315-4194-aef1-62602838099a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8f0e93-52cc-41d8-808a-af1aaee753cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-31767da9-f1ab-4749-9290-3f03eb474591" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Creating volume 31767da9-f1ab-4749-9290-3f03eb474591 from snapshot b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Volume volume-b8cea4d3-d315-4194-aef1-62602838099a (b8cea4d3-d315-4194-aef1-62602838099a): created successfully Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8f0e93-52cc-41d8-808a-af1aaee753cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Flow 'volume_create_manager' (6f0afb2b-3aed-4702-ac4b-2b61e8665d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] snapshot: b5432e04-5366-4c6e-8bd4-bd234d9af8b5, volume: 31767da9-f1ab-4749-9290-3f03eb474591, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:46:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d9160554-06c7-4e87-a19a-7b904364173d tempest-ServersNegativeTestJSON-1258183772 None] Created volume successfully. Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c8a15f-de55-4dec-a5e6-ee4d68a54706]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:27 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:27 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:28 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798de8e0-d280-42a8-8e97-ff3ab3208288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[94efe51f-26c8-45b2-9c4e-272620562c51]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:28 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:28 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:28 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:28 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 Sep 06 22:46:28 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "cinder-b8cea4d3-d315-4194-aef1-62602838099a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-b8cea4d3-d315-4194-aef1-62602838099a-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "cinder-quobyte-b8cea4d3-d315-4194-aef1-62602838099a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-quobyte-b8cea4d3-d315-4194-aef1-62602838099a" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e3a08-5488-4b6a-a3b7-89f7b684e9ef]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:30 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a Sep 06 22:46:30 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:30 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a" returned: 0 in 0.766s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:30 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a Sep 06 22:46:30 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:31 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b8cea4d3-d315-4194-aef1-62602838099a" returned: 0 in 0.953s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-quobyte-b8cea4d3-d315-4194-aef1-62602838099a" released by "delete_volume" :: held 1.822s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Created reservations ['50ba7faa-4f07-4b98-8206-c6ec8e97b26c', 'bf753f9b-1209-40fd-ac27-a13b66aaf823', '7beb08b6-8624-4211-975b-792ddb69d549', '1feecf86-5c7b-4e23-bc5c-bed74e3f3d9c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:32 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:32 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "cinder-d284ec45-1e47-4a57-b0b4-431ae7e191b8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-d284ec45-1e47-4a57-b0b4-431ae7e191b8-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "cinder-quobyte-d284ec45-1e47-4a57-b0b4-431ae7e191b8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-quobyte-d284ec45-1e47-4a57-b0b4-431ae7e191b8" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae23c4cb-bd91-49ee-af31-927117654992]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:32 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Deleted volume successfully. Sep 06 22:46:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc997d02-4b52-42f7-a9a7-465d974a0aaf tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-b8cea4d3-d315-4194-aef1-62602838099a-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:33 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 Sep 06 22:46:33 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:33 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8" returned: 0 in 1.036s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:33 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8 Sep 06 22:46:33 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:34 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d284ec45-1e47-4a57-b0b4-431ae7e191b8" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-quobyte-d284ec45-1e47-4a57-b0b4-431ae7e191b8" released by "delete_volume" :: held 1.524s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Created reservations ['3b1faad3-c586-4155-8c39-3fd69d3b0acd', '9bc1b3d7-9aa5-4638-88ed-fdea5e5c8b4d', '52b4f0fd-3383-4816-afd1-a30f2cd4bdf6', '0356749a-a45b-4494-85ef-000ff533e194'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:34 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591" returned: 0 in 5.601s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:46:34 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Converted 1024.00 MB image at 182.80 MB/s Sep 06 22:46:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 is being set with open permissions: ugo+rw Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:34 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 Sep 06 22:46:34 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:34 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:34 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:34 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" released by "_copy_volume_from_snapshot" :: held 6.703s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:34 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Deleted volume successfully. Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-31767da9-f1ab-4749-9290-3f03eb474591" released by "_create_volume_from_snapshot" :: held 6.810s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.842s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-739a4bc1-5e45-4114-8ba8-ea3e700d9f76 tempest-ServersNegativeTestJSON-1258183772 None] Lock "cinder-d284ec45-1e47-4a57-b0b4-431ae7e191b8-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd2b9e-7a8d-4988-ba38-86850ec0654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31767da9-f1ab-4749-9290-3f03eb474591', 'volume_size': 1, 'snapshot_id': 'b5432e04-5366-4c6e-8bd4-bd234d9af8b5'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b71c6-bec9-4edb-92fd-855e28f80807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Volume volume-31767da9-f1ab-4749-9290-3f03eb474591 (31767da9-f1ab-4749-9290-3f03eb474591): created successfully Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b71c6-bec9-4edb-92fd-855e28f80807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Flow 'volume_create_manager' (296fc3ee-3304-460f-9cbd-637676c3332a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4139d05c-3571-4d74-9c6d-08bbd0abb087 tempest-VolumesDeleteCascade-783810103 None] Created volume successfully. Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-798de8e0-d280-42a8-8e97-ff3ab3208288-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-798de8e0-d280-42a8-8e97-ff3ab3208288-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Performing cascade delete. {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Deleting offline snapshot b5432e04-5366-4c6e-8bd4-bd234d9af8b5 of volume 798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] snapshot_file for this snap is: volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8087ab9-db1d-4eca-8062-e38cf7628ebf]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:35 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:35 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:36 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798de8e0-d280-42a8-8e97-ff3ab3208288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[200ff654-d0d1-4d5b-ae9b-32fccc3cfb85]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:36 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:36 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:36 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.630s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:36 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:36 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:37 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:37 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5 Sep 06 22:46:37 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:37 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288.b5432e04-5366-4c6e-8bd4-bd234d9af8b5" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-b5432e04-5366-4c6e-8bd4-bd234d9af8b5" released by "_delete_snapshot" :: held 1.844s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" released by "delete_snapshot" :: held 1.882s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Created reservations ['81bb9766-8b6a-4cd7-9253-ce2dd777bd37', '5827022d-ee9f-4a13-a533-d1565e1fd6a1', 'a7d38da4-6e8b-474a-b696-6990d0ceb5bd', 'fce78173-4cfe-4d07-adda-36130308904d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Delete snapshot completed successfully. Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-b5432e04-5366-4c6e-8bd4-bd234d9af8b5-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Snapshots deleted, issuing volume delete {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d770ab2-2186-413e-8bf5-ab94a23be4b2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:38 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:38 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:38 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.558s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:38 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288 Sep 06 22:46:38 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:39 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-798de8e0-d280-42a8-8e97-ff3ab3208288" returned: 0 in 0.578s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-798de8e0-d280-42a8-8e97-ff3ab3208288" released by "delete_volume" :: held 1.254s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Created reservations ['0fbd1185-b5e0-479b-96af-045bf11de221', 'afb241da-85af-4aa9-a3e2-be5a330c9084', '9d51d7e7-122f-4203-86b1-1099bd3e3def', 'ae524217-fcad-48ac-ba6f-e28af5a79942'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:39 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:39 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:39 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Deleted volume successfully. Sep 06 22:46:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-420a80c5-5c3f-44a8-8b77-9f486e6d6c12 tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-798de8e0-d280-42a8-8e97-ff3ab3208288-delete_volume" released by "delete_volume" :: held 4.110s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-31767da9-f1ab-4749-9290-3f03eb474591-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-31767da9-f1ab-4749-9290-3f03eb474591-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab113e2-93a3-4964-b641-4bec1b9e9eff]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:40 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 Sep 06 22:46:40 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:40 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:41 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591 Sep 06 22:46:41 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:41 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31767da9-f1ab-4749-9290-3f03eb474591" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-quobyte-31767da9-f1ab-4749-9290-3f03eb474591" released by "delete_volume" :: held 0.899s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Created reservations ['5288bc35-f71a-4f73-b511-115d4502a7c0', 'a5101b3b-8dc2-4399-8e66-8f17b08272a5', 'c1860c37-3895-4e78-bf5b-fc676c72a27d', 'cc9b4ce0-d2aa-4ba1-bce7-a2179f3e1cd8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:41 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:41 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Flow 'volume_create_manager' (e50eb815-3b82-486d-8910-38e8ca8fb0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8936f46-55d9-499c-8e78-8d903c0d2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8936f46-55d9-499c-8e78-8d903c0d2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1996317144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16840051f2b94f9087a410611e46e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:42Z,use_quota=True,user_id='1c6aed4ff2e44c5190b45c4ce3e3d574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8da4e4-f3c2-45f2-b0ea-0abf228e2ae2),volume_type_id=dd8da4e4-f3c2-45f2-b0ea-0abf228e2ae2)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bf32f3-d9f3-4558-8a42-d563e3400dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bf32f3-d9f3-4558-8a42-d563e3400dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60a4fc4-8662-4671-ad32-3af8d0d25e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60a4fc4-8662-4671-ad32-3af8d0d25e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e', 'volume_name': 'volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c4b246-3e9b-40f8-8bdb-02bc4bf625b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c4b246-3e9b-40f8-8bdb-02bc4bf625b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d41735-b279-4988-96db-3f35f5478d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Volume c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e', 'volume_size': 1} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1996317144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16840051f2b94f9087a410611e46e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:42Z,use_quota=True,user_id='1c6aed4ff2e44c5190b45c4ce3e3d574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8da4e4-f3c2-45f2-b0ea-0abf228e2ae2),volume_type_id=dd8da4e4-f3c2-45f2-b0ea-0abf228e2ae2)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Creating volume c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:41 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-dbb2657f-7c29-4152-8816-ee9465e84410 tempest-ServerActionsTestOtherA-759551995 None] Terminate volume connection completed successfully. Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-dbb2657f-7c29-4152-8816-ee9465e84410 tempest-ServerActionsTestOtherA-759551995 None] Deleting attachment 59bbe3db-dbf5-401b-94f6-59937259b387. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:46:41 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e 1073741824 Sep 06 22:46:41 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:41 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Deleted volume successfully. Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "cinder-3902ff65-39f9-4703-8fe6-f27c5c213135-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7a12c28b-e040-49d3-8b01-95e12e780fef tempest-VolumesDeleteCascade-783810103 None] Lock "cinder-31767da9-f1ab-4749-9290-3f03eb474591-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-3902ff65-39f9-4703-8fe6-f27c5c213135-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "cinder-quobyte-3902ff65-39f9-4703-8fe6-f27c5c213135" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-quobyte-3902ff65-39f9-4703-8fe6-f27c5c213135" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0e261-b3dd-4cbf-9c78-fd92cb642e96]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:42 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 Sep 06 22:46:42 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:42 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e 1073741824" returned: 0 in 0.524s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:42 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e Sep 06 22:46:42 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:42 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:42 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135 Sep 06 22:46:42 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:42 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d41735-b279-4988-96db-3f35f5478d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c2f0a3-2966-4b15-b3f9-e9f4705c110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Volume volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e (c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e): created successfully Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c2f0a3-2966-4b15-b3f9-e9f4705c110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Flow 'volume_create_manager' (e50eb815-3b82-486d-8910-38e8ca8fb0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4d97efea-5515-45b4-a3a3-df00658027f9 tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Created volume successfully. Sep 06 22:46:42 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3902ff65-39f9-4703-8fe6-f27c5c213135" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-quobyte-3902ff65-39f9-4703-8fe6-f27c5c213135" released by "delete_volume" :: held 0.914s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "cinder-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:42 devstack cinder-volume[87517]: DEBUG cinder.quota [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Created reservations ['c8c45496-9789-4e16-be7e-882a1f722ecd', 'b0b4cf0a-0fe0-4601-b80c-e43619d09441', 'e4f8c78b-c7f4-4801-9ae8-6a5295f4655e', 'c06762ad-faa2-464c-ba42-7c84204cd530'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "cinder-quobyte-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-quobyte-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe623dc-f0d5-4d38-bc53-da06bb27c53f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:43 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:43 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:43 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 Sep 06 22:46:43 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:43 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.manager [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Deleted volume successfully. Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-b3e2ce4e-6ff9-4343-a310-fc0ce5078a5a req-fe2d5529-8466-47a6-8f9f-8294e02e2561 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-3902ff65-39f9-4703-8fe6-f27c5c213135-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:43 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:43 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33 Sep 06 22:46:43 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:43 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-quobyte-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33" released by "delete_volume" :: held 0.882s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Created reservations ['887e3719-0525-4485-ba3a-c7bb39ace402', '8176cfcf-1b1d-4e90-bbb4-596318cd2544', '77b4df38-767b-4a4e-9bd0-509c21421963', '25a881db-2d1c-4f8c-8717-64a81fd4896d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:44 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:44 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:44 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:44 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:44 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.479s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Deleted volume successfully. Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f42914d-3d52-4d6d-9452-a5edb5f06ed5 tempest-ServerActionsTestOtherA-759551995 None] Lock "cinder-acc0aeeb-e969-4ad5-a55c-4e3f9c46ae33-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:44 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d2fe065b-6cef-4266-8b2d-cd92785341df tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Retype volume completed successfully. Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "cinder-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "cinder-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "cinder-quobyte-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "cinder-quobyte-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04abf2-4bc8-4ecb-9147-6cdd8b5fe771]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:46 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e Sep 06 22:46:46 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:46 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:46 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e Sep 06 22:46:46 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:46 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "cinder-quobyte-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e" released by "delete_volume" :: held 0.794s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:46 devstack cinder-volume[87517]: WARNING cinder.quota [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:46:46 devstack cinder-volume[87517]: WARNING cinder.quota [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Created reservations ['2e681ea9-1214-4b2a-97a4-02721b632915', 'b7459244-a791-4457-b03b-1a1e71e34e1e', '27a8a34e-765a-4ada-83f1-a5417d623e15', '00e35abe-2731-4576-b123-3d3dcb17725f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:47 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:47 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:47 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.575s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Deleted volume successfully. Sep 06 22:46:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31f6c193-c9e5-44f3-946f-e65dc867895f tempest-VolumeRetypeWithoutMigrationTest-908381678 None] Lock "cinder-c10e4c35-b9a5-4385-b1d4-031bcd8b4a3e-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Flow 'volume_create_manager' (d7af0685-593f-4b54-a4fb-80ef84ef77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ca776-5de4-46f3-a77e-b53f872da165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ca776-5de4-46f3-a77e-b53f872da165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2037141876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee7166d-b781-4c5b-a492-2d6f6462c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0039e996d66f42a18c7414c385750269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:48Z,use_quota=True,user_id='2d175c582f4947adad8589b3e7b7c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ba8add-9e61-4746-9866-3a69f192e23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ba8add-9e61-4746-9866-3a69f192e23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1fd313-596f-4b18-91a4-567445fa3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1fd313-596f-4b18-91a4-567445fa3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee7166d-b781-4c5b-a492-2d6f6462c7c4', 'volume_name': 'volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f25ca-f74f-49cd-8454-33a5e95b3498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f25ca-f74f-49cd-8454-33a5e95b3498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5acbf9-e7e3-4424-b1b2-79412f2855fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Volume 5ee7166d-b781-4c5b-a492-2d6f6462c7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4', 'volume_size': 1} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2037141876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee7166d-b781-4c5b-a492-2d6f6462c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0039e996d66f42a18c7414c385750269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:46:48Z,use_quota=True,user_id='2d175c582f4947adad8589b3e7b7c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Creating volume 5ee7166d-b781-4c5b-a492-2d6f6462c7c4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:46:48 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:48 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 1073741824 Sep 06 22:46:48 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:49 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 1073741824" returned: 0 in 0.543s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:49 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 Sep 06 22:46:49 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:49 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5acbf9-e7e3-4424-b1b2-79412f2855fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668bcc5b-be3c-4500-a9f6-cef860a54628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:46:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Volume volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 (5ee7166d-b781-4c5b-a492-2d6f6462c7c4): created successfully Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668bcc5b-be3c-4500-a9f6-cef860a54628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Flow 'volume_create_manager' (d7af0685-593f-4b54-a4fb-80ef84ef77f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:46:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ea98b58-a566-4a3e-8b41-892c36595134 tempest-VolumesMetadataTest-2017200012 None] Created volume successfully. Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Acquiring lock "cinder-5ee7166d-b781-4c5b-a492-2d6f6462c7c4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "cinder-5ee7166d-b781-4c5b-a492-2d6f6462c7c4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Acquiring lock "cinder-quobyte-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "cinder-quobyte-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bc5ab0-aa52-49f6-837a-50bb6eb0bc7e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:51 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 Sep 06 22:46:51 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:52 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:52 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4 Sep 06 22:46:52 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:52 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "cinder-quobyte-5ee7166d-b781-4c5b-a492-2d6f6462c7c4" released by "delete_volume" :: held 0.820s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Created reservations ['d34b831f-168c-45f3-9a8e-18c3cf5c7f82', '768f991c-db5c-43d8-8216-dafc06bd1af0', '50daa2f3-03b5-41d7-9ef7-789c17ea48df', 'df46f303-da8e-4a79-b538-70005d07fa90'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:46:52 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:46:52 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:46:53 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Sep 06 22:46:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:46:53 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:46:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Deleted volume successfully. Sep 06 22:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c8de1750-d015-4310-b901-95e90529156e tempest-VolumesMetadataTest-2017200012 None] Lock "cinder-5ee7166d-b781-4c5b-a492-2d6f6462c7c4-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:02 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=79,cinder:INSERT=30,cinder:UPDATE=120,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=87,cinder:INSERT=25,cinder:UPDATE=104,cinder:DELETE=12 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Flow 'volume_create_manager' (de05a39b-bd89-4bc3-9006-bba12adce3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0ca3e1-3525-4ab6-9a75-2bd8dcf3d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0ca3e1-3525-4ab6-9a75-2bd8dcf3d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875959795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa0757d-b850-4147-95b7-3037103e6452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1657eaaa8044c5b2fa4bdd139fbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:04Z,use_quota=True,user_id='21e39faee4ab4ca9b428bc2253c714ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400470e7-6824-4508-91a2-b1003ed936c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400470e7-6824-4508-91a2-b1003ed936c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd531f4-20c8-4de9-9999-1a49521698ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd531f4-20c8-4de9-9999-1a49521698ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa0757d-b850-4147-95b7-3037103e6452', 'volume_name': 'volume-caa0757d-b850-4147-95b7-3037103e6452', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e799d1-bc6e-4979-b583-fedd56f2120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e799d1-bc6e-4979-b583-fedd56f2120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199586a6-7bdd-42f4-8b8e-c19bb94feb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Volume caa0757d-b850-4147-95b7-3037103e6452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa0757d-b850-4147-95b7-3037103e6452', 'volume_size': 1} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875959795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa0757d-b850-4147-95b7-3037103e6452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1657eaaa8044c5b2fa4bdd139fbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:04Z,use_quota=True,user_id='21e39faee4ab4ca9b428bc2253c714ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Creating volume caa0757d-b850-4147-95b7-3037103e6452 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:47:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:47:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:03 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 1073741824 Sep 06 22:47:03 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:04 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 1073741824" returned: 0 in 0.544s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:04 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 Sep 06 22:47:04 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:04 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199586a6-7bdd-42f4-8b8e-c19bb94feb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa0757d-b850-4147-95b7-3037103e6452', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75aff238-49a8-4aa6-9f3b-61089e1e050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Volume volume-caa0757d-b850-4147-95b7-3037103e6452 (caa0757d-b850-4147-95b7-3037103e6452): created successfully Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75aff238-49a8-4aa6-9f3b-61089e1e050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Flow 'volume_create_manager' (de05a39b-bd89-4bc3-9006-bba12adce3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12b22231-53cd-4a63-a9b5-5e4f0578d5e8 tempest-VolumesTransfersV357Test-700660074 None] Created volume successfully. Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:05 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:47:05 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:05 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:47:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:47:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:47:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:47:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2dd2f0e2-61e7-4d86-831d-1ea28bcd4125 tempest-VolumesTransfersV357Test-1720221695 None] Transfer volume completed successfully. Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "cinder-caa0757d-b850-4147-95b7-3037103e6452-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-caa0757d-b850-4147-95b7-3037103e6452-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "cinder-quobyte-caa0757d-b850-4147-95b7-3037103e6452" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-quobyte-caa0757d-b850-4147-95b7-3037103e6452" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[29211916-b680-47fd-8fac-b07f643d98df]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:08 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 Sep 06 22:47:08 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:08 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:08 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452 Sep 06 22:47:08 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:09 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-caa0757d-b850-4147-95b7-3037103e6452" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-quobyte-caa0757d-b850-4147-95b7-3037103e6452" released by "delete_volume" :: held 0.843s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Created reservations ['8094cfe0-942b-473b-bf01-b67af5d8fd13', '392a5a9a-a107-41f0-a44e-be41bc0deb43', '1b4cddac-8138-416d-906f-4f20deba84f2', '524b92e9-7f67-4f2c-b4ab-70874ee195bc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:09 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:47:09 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:09 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:47:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Deleted volume successfully. Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce396f39-cd4b-4889-ab66-b4308168ba65 tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-caa0757d-b850-4147-95b7-3037103e6452-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Flow 'volume_create_manager' (cbb8a4fc-c760-4635-b925-d3df6899ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3fa861-2c50-4735-a6d7-5d6d96107a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3fa861-2c50-4735-a6d7-5d6d96107a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985788791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93ef2e9-aee2-46c2-84cb-cd982756bb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1657eaaa8044c5b2fa4bdd139fbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:10Z,use_quota=True,user_id='21e39faee4ab4ca9b428bc2253c714ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daedc6b5-facb-496f-8a9c-88a5a11f9904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daedc6b5-facb-496f-8a9c-88a5a11f9904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34570334-6c7f-499d-a303-5beb296ab157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34570334-6c7f-499d-a303-5beb296ab157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93ef2e9-aee2-46c2-84cb-cd982756bb20', 'volume_name': 'volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522142e3-d0c4-465e-97b7-6684c52710f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522142e3-d0c4-465e-97b7-6684c52710f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec1106-1da3-4024-9290-65a09f48ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Volume d93ef2e9-aee2-46c2-84cb-cd982756bb20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20', 'volume_size': 1} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985788791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93ef2e9-aee2-46c2-84cb-cd982756bb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1657eaaa8044c5b2fa4bdd139fbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:10Z,use_quota=True,user_id='21e39faee4ab4ca9b428bc2253c714ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Creating volume d93ef2e9-aee2-46c2-84cb-cd982756bb20 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:47:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:10 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 1073741824 Sep 06 22:47:10 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:10 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 1073741824" returned: 0 in 0.543s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:10 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 Sep 06 22:47:10 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:10 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec1106-1da3-4024-9290-65a09f48ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551ba333-a1ee-4fb6-b646-6fc54cf36106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Volume volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 (d93ef2e9-aee2-46c2-84cb-cd982756bb20): created successfully Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551ba333-a1ee-4fb6-b646-6fc54cf36106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Flow 'volume_create_manager' (cbb8a4fc-c760-4635-b925-d3df6899ec77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b651cc9e-fb64-4fc4-abf1-ed023a3c2954 tempest-VolumesTransfersV357Test-700660074 None] Created volume successfully. Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "cinder-d93ef2e9-aee2-46c2-84cb-cd982756bb20-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-d93ef2e9-aee2-46c2-84cb-cd982756bb20-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "cinder-quobyte-d93ef2e9-aee2-46c2-84cb-cd982756bb20" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-quobyte-d93ef2e9-aee2-46c2-84cb-cd982756bb20" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d95223-d6a2-49b7-b528-e96883f7a811]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:12 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 Sep 06 22:47:12 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:13 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:13 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20 Sep 06 22:47:13 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:13 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d93ef2e9-aee2-46c2-84cb-cd982756bb20" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-quobyte-d93ef2e9-aee2-46c2-84cb-cd982756bb20" released by "delete_volume" :: held 1.006s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Created reservations ['511b8bcb-db4b-460e-a343-137e6b26ef6d', 'ce2f81e7-994f-4c7c-9731-3de78eca6c32', 'fe60b988-a903-451a-9950-1358c3bbf40b', '64bf3349-0819-4f83-be57-9960eb950535'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:13 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:47:13 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:14 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.496s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:14 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:47:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Deleted volume successfully. Sep 06 22:47:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ebcd1fc-96e4-413b-b6ea-9f7d028ed65f tempest-VolumesTransfersV357Test-716558347 None] Lock "cinder-d93ef2e9-aee2-46c2-84cb-cd982756bb20-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:23 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:24 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=23,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Flow 'volume_create_manager' (4998f0c3-c29d-4cb0-bdc3-e7bd403c464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f64de4-8a3e-412a-9cb3-1a8979258ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f64de4-8a3e-412a-9cb3-1a8979258ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1902226975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c3eeed-fd04-49a9-ac96-419ebe95a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd0c01e0a02441b895bf6a9f5f69853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:28Z,use_quota=True,user_id='b21a485e2f8d40349ce1a1026d8b6c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8fe904-e248-45a8-9a02-93018c4dfa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8fe904-e248-45a8-9a02-93018c4dfa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41457a-afb7-4907-8e70-21d542a918aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41457a-afb7-4907-8e70-21d542a918aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'volume_name': 'volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ee95de-7012-4784-b40a-7dbada5e74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ee95de-7012-4784-b40a-7dbada5e74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188acc1-ccd3-4884-ac5d-9986cbf5bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Volume c1c3eeed-fd04-49a9-ac96-419ebe95a786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'volume_size': 1} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1902226975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c3eeed-fd04-49a9-ac96-419ebe95a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd0c01e0a02441b895bf6a9f5f69853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:28Z,use_quota=True,user_id='b21a485e2f8d40349ce1a1026d8b6c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Creating volume c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:47:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:47:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:28 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 1073741824 Sep 06 22:47:28 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:29 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 1073741824" returned: 0 in 0.854s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:29 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:29 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:29 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188acc1-ccd3-4884-ac5d-9986cbf5bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d80dea-3962-497c-9011-86da685b9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Volume volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 (c1c3eeed-fd04-49a9-ac96-419ebe95a786): created successfully Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d80dea-3962-497c-9011-86da685b9069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Flow 'volume_create_manager' (4998f0c3-c29d-4cb0-bdc3-e7bd403c464d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8f1461cf-4d92-40d1-9860-165b2a94a223 tempest-VolumesCloneTest-881255702 None] Created volume successfully. Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Flow 'volume_create_manager' (0e514e3a-9485-4ba0-8c9d-1dcf0d8e0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98340ea-a8aa-49fc-a865-e31c10f64baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98340ea-a8aa-49fc-a865-e31c10f64baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1351108572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783033a4-01a1-4672-98e6-2bcda56e8f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd0c01e0a02441b895bf6a9f5f69853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c1c3eeed-fd04-49a9-ac96-419ebe95a786,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:31Z,use_quota=True,user_id='b21a485e2f8d40349ce1a1026d8b6c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b53d5f5-ce15-412e-bc72-47aee9b474c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b53d5f5-ce15-412e-bc72-47aee9b474c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54d553e-2fc4-4e95-b664-2977906671d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54d553e-2fc4-4e95-b664-2977906671d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '783033a4-01a1-4672-98e6-2bcda56e8f52', 'volume_name': 'volume-783033a4-01a1-4672-98e6-2bcda56e8f52', 'volume_size': 2, 'source_volid': 'c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e444e80-f9af-48f6-be2f-fd1f7e0b32e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e444e80-f9af-48f6-be2f-fd1f7e0b32e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fffbe2f-6fa2-4887-82bf-e62b3cebf2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Volume 783033a4-01a1-4672-98e6-2bcda56e8f52: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-783033a4-01a1-4672-98e6-2bcda56e8f52', 'volume_size': 2, 'source_volid': 'c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'source_volstatus': 'available'} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Cloning volume c1c3eeed-fd04-49a9-ac96-419ebe95a786 to volume 783033a4-01a1-4672-98e6-2bcda56e8f52 Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Creating offline snapshot 0de53450-3e6d-41de-88dc-acca1a0e276c of volume c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a4cb1-5250-4ef1-a5d7-8eed2eb887a3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:31 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:31 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:32 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 0.485s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:32 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c 1G Sep 06 22:47:32 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:32 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c 1G" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:32 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:32 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:32 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:32 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c is being set with open permissions: ugo+rw Sep 06 22:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:32 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:32 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:33 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:33 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info Sep 06 22:47:33 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:33 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:33 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info is being set with open permissions: ugo+rw Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:33 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info Sep 06 22:47:33 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:33 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.info" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] snapshot: 0de53450-3e6d-41de-88dc-acca1a0e276c, volume: 783033a4-01a1-4672-98e6-2bcda56e8f52, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd975d58-c4c2-4c4d-ab46-449c5b3d7562]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:34 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:34 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:34 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 0.667s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e5db2-1b2b-49c7-856d-b1728f5a3844]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:34 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:34 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:35 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 0.641s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:47:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:47:35 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:47:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:35 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 Sep 06 22:47:35 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:43 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:43 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:47:46 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52" returned: 0 in 10.831s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:46 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786, size 1024.00 MB, duration 10.83 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:47:46 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Converted 1024.00 MB image at 94.53 MB/s Sep 06 22:47:46 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 is being set with open permissions: ugo+rw Sep 06 22:47:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:46 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 Sep 06 22:47:46 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:47 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52" returned: 0 in 0.909s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" released by "_copy_volume_from_snapshot" :: held 13.241s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-quobyte-0de53450-3e6d-41de-88dc-acca1a0e276c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-0de53450-3e6d-41de-88dc-acca1a0e276c" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Deleting offline snapshot 0de53450-3e6d-41de-88dc-acca1a0e276c of volume c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] snapshot_file for this snap is: volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c9d81-fc90-4408-bb5e-0d81ca0304e6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:47 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:47 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:48 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 1.000s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3ff95-42d6-4644-ad5e-2cb856b8507e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (2e107896-3794-4144-b0df-ef7815352a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452b0125-73d8-44e6-b39d-1f794e3df441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452b0125-73d8-44e6-b39d-1f794e3df441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542467010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba636192-d74f-4045-9b77-ca9b3e33ed78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:48Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaf8abc-2196-4206-90cd-519c3afe66fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaf8abc-2196-4206-90cd-519c3afe66fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42882bb6-14f6-4d0e-8eea-12ef3b723f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42882bb6-14f6-4d0e-8eea-12ef3b723f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba636192-d74f-4045-9b77-ca9b3e33ed78', 'volume_name': 'volume-ba636192-d74f-4045-9b77-ca9b3e33ed78', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc4f3dd-5037-4a68-a5ee-53ae67914d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc4f3dd-5037-4a68-a5ee-53ae67914d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea158dbb-86cf-4a0b-8324-eae03935c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Volume ba636192-d74f-4045-9b77-ca9b3e33ed78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba636192-d74f-4045-9b77-ca9b3e33ed78', 'volume_size': 1} Sep 06 22:47:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:48 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:48 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:49 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 1.454s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:49 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:49 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:50 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 0.858s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:50 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c Sep 06 22:47:50 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:51 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786.0de53450-3e6d-41de-88dc-acca1a0e276c" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-0de53450-3e6d-41de-88dc-acca1a0e276c" released by "_delete_snapshot" :: held 3.984s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.857s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542467010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba636192-d74f-4045-9b77-ca9b3e33ed78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:48Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Creating volume ba636192-d74f-4045-9b77-ca9b3e33ed78 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:47:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:51 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 1073741824 Sep 06 22:47:51 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fffbe2f-6fa2-4887-82bf-e62b3cebf2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783033a4-01a1-4672-98e6-2bcda56e8f52', 'volume_size': 2, 'source_volid': 'c1c3eeed-fd04-49a9-ac96-419ebe95a786', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6587da9c-98d5-4b7a-9d8d-f3b2284e3692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Volume volume-783033a4-01a1-4672-98e6-2bcda56e8f52 (783033a4-01a1-4672-98e6-2bcda56e8f52): created successfully Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6587da9c-98d5-4b7a-9d8d-f3b2284e3692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Flow 'volume_create_manager' (0e514e3a-9485-4ba0-8c9d-1dcf0d8e0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a97746a5-3ea9-4976-928c-5be1edbe7407 tempest-VolumesCloneTest-881255702 None] Created volume successfully. Sep 06 22:47:52 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 1073741824" returned: 0 in 0.991s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:52 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 Sep 06 22:47:52 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-783033a4-01a1-4672-98e6-2bcda56e8f52-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "cinder-783033a4-01a1-4672-98e6-2bcda56e8f52-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b65a9bb-e26f-4ecb-83e9-432472b7134b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:52 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 Sep 06 22:47:52 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:52 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:47:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea158dbb-86cf-4a0b-8324-eae03935c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba636192-d74f-4045-9b77-ca9b3e33ed78', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e1a559-f335-445b-8e2b-9ff970b189e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Volume volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 (ba636192-d74f-4045-9b77-ca9b3e33ed78): created successfully Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e1a559-f335-445b-8e2b-9ff970b189e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (2e107896-3794-4144-b0df-ef7815352a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca558d1b-f0ac-4818-a8e8-a3378fe28004 tempest-AttachVolumeNegativeTest-1990295743 None] Created volume successfully. Sep 06 22:47:53 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52" returned: 0 in 0.634s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:53 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52 Sep 06 22:47:53 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:53 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-783033a4-01a1-4672-98e6-2bcda56e8f52" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-783033a4-01a1-4672-98e6-2bcda56e8f52" released by "delete_volume" :: held 1.052s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Created reservations ['201a1e8b-5519-4cfa-be06-55e1d1180019', '486cab61-e10b-4a29-be32-77a35f9eec8f', '4268a25e-a80f-43fb-9403-26346b392828', '83376a99-3902-47b9-a0ec-ad4d48eff9a1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:53 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:47:53 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:54 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:54 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:47:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Deleted volume successfully. Sep 06 22:47:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d0a8523-7547-4bf3-9dcc-e9a508ac7e12 tempest-VolumesCloneTest-881255702 None] Lock "cinder-783033a4-01a1-4672-98e6-2bcda56e8f52-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-c1c3eeed-fd04-49a9-ac96-419ebe95a786-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "cinder-c1c3eeed-fd04-49a9-ac96-419ebe95a786-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-432db47c-619b-4cb3-9d7a-ea1f33f096ec req-e3f0e15c-4bb0-4a9a-b861-2d8a244e0f40 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-432db47c-619b-4cb3-9d7a-ea1f33f096ec req-e3f0e15c-4bb0-4a9a-b861-2d8a244e0f40 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-432db47c-619b-4cb3-9d7a-ea1f33f096ec req-e3f0e15c-4bb0-4a9a-b861-2d8a244e0f40 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Acquiring lock "cinder-quobyte-c1c3eeed-fd04-49a9-ac96-419ebe95a786" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-432db47c-619b-4cb3-9d7a-ea1f33f096ec req-e3f0e15c-4bb0-4a9a-b861-2d8a244e0f40 tempest-AttachVolumeNegativeTest-1990295743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-ba636192-d74f-4045-9b77-ca9b3e33ed78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3554dc8-d5dc-45bc-b378-105dbc854f53', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-c1c3eeed-fd04-49a9-ac96-419ebe95a786" acquired by "delete_volume" :: waited 0.052s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d5dab-bcf9-4408-a155-ce36fcbeeb92]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:47:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-432db47c-619b-4cb3-9d7a-ea1f33f096ec req-e3f0e15c-4bb0-4a9a-b861-2d8a244e0f40 tempest-AttachVolumeNegativeTest-1990295743 None] attachment_update completed successfully. Sep 06 22:47:55 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:55 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:56 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 0.857s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:56 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786 Sep 06 22:47:56 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:57 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c1c3eeed-fd04-49a9-ac96-419ebe95a786" returned: 0 in 0.797s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "cinder-quobyte-c1c3eeed-fd04-49a9-ac96-419ebe95a786" released by "delete_volume" :: held 1.776s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Created reservations ['eeb9aab5-44a8-4194-a794-646a8af3e26b', '9ca9591a-af96-469e-ab4b-8b6775006fbe', '89030f90-ce8c-4e66-a75c-5d8c1fdbb38d', '48c972d1-8d61-4404-aefc-a3c966e5f170'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:57 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:47:57 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:57 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:47:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Deleted volume successfully. Sep 06 22:47:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3726d700-e6bc-4b7b-95f3-30aee53ceee7 tempest-VolumesCloneTest-881255702 None] Lock "cinder-c1c3eeed-fd04-49a9-ac96-419ebe95a786-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Flow 'volume_create_manager' (0d6eb362-9d4b-42cd-8a48-4f60000c4a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b06b41c-2b72-44eb-8d21-d1c5efe645d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b06b41c-2b72-44eb-8d21-d1c5efe645d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1158577793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a33ed6-e2aa-409e-a86f-12bedc50bb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11af9f978ac44375a634ad442a27fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:58Z,use_quota=True,user_id='647f4c62ac304adf83f20e55c8ef562d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2cb91a-217e-41df-b7e0-8daafdeac475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2cb91a-217e-41df-b7e0-8daafdeac475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34190d76-0559-4f23-9d95-1616c94a10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34190d76-0559-4f23-9d95-1616c94a10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a33ed6-e2aa-409e-a86f-12bedc50bb98', 'volume_name': 'volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecb9621-eca8-4e65-91a1-4110ebddc957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecb9621-eca8-4e65-91a1-4110ebddc957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec4ac67-effb-41e3-94ef-701ce7af6738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Volume d7a33ed6-e2aa-409e-a86f-12bedc50bb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98', 'volume_size': 1} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1158577793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a33ed6-e2aa-409e-a86f-12bedc50bb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11af9f978ac44375a634ad442a27fde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:47:58Z,use_quota=True,user_id='647f4c62ac304adf83f20e55c8ef562d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Creating volume d7a33ed6-e2aa-409e-a86f-12bedc50bb98 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:47:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:47:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:58 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 1073741824 Sep 06 22:47:58 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:59 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 1073741824" returned: 0 in 0.790s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:47:59 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 Sep 06 22:47:59 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:47:59 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec4ac67-effb-41e3-94ef-701ce7af6738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8d5f18-2749-43fc-808e-83a89d7c136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:47:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Volume volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 (d7a33ed6-e2aa-409e-a86f-12bedc50bb98): created successfully Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8d5f18-2749-43fc-808e-83a89d7c136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:47:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Flow 'volume_create_manager' (0d6eb362-9d4b-42cd-8a48-4f60000c4a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:47:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1fcb53c8-ce29-40dd-b79d-60eaae437bae tempest-ServerRescueNegativeTestJSON-357186502 None] Created volume successfully. Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:05 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:05 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:06 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.472s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:48:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:48:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Flow 'volume_create_manager' (72f6b76e-e9c4-4184-9f1c-9690e5688f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073fdd0c-ac25-4a44-9989-b38a9ee855fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073fdd0c-ac25-4a44-9989-b38a9ee855fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1054121453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d29d956-ddf3-4c11-8471-8df6c4fdfbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483e076a2f3442fabfbeb405d52f7d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:08Z,use_quota=True,user_id='5a818c2b83104c3792d127442c039b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ee6821-a325-438c-8787-a0f4e9f7b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ee6821-a325-438c-8787-a0f4e9f7b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8feb1d8-012f-48bd-8de0-10078320c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:08 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:48:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8feb1d8-012f-48bd-8de0-10078320c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d29d956-ddf3-4c11-8471-8df6c4fdfbf9', 'volume_name': 'volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca91ecdf-739a-4c40-bca1-ef85d24ed946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca91ecdf-739a-4c40-bca1-ef85d24ed946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c779cbc9-0400-4f8f-8778-9cc859e17f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 22:48:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Trying to clone 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 from image 783de45c-ba65-43ef-be94-87e88c8ed95b at location (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:48:10 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD, size 20.69 MB, duration 1.22 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:48:10 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Image download 20.69 MB at 16.95 MB/s Sep 06 22:48:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (f5429c76-692e-4966-81d7-1969b1d4d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f4e067-0db6-466a-9a3f-cfeabdf11333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[72168720-0865-46ba-89bc-b60c2b29ae6f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f4e067-0db6-466a-9a3f-cfeabdf11333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128633657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12199525-9243-4ddc-bb25-3a8cdb32edd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:11Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c381be-ed9d-4c7b-b38b-f6e22806ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c381be-ed9d-4c7b-b38b-f6e22806ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb057d-6f5c-4fc9-a7c6-fd7545ae29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb057d-6f5c-4fc9-a7c6-fd7545ae29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12199525-9243-4ddc-bb25-3a8cdb32edd2', 'volume_name': 'volume-12199525-9243-4ddc-bb25-3a8cdb32edd2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77112ccd-2404-45a0-a85c-7cce05204d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77112ccd-2404-45a0-a85c-7cce05204d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f318ea48-4456-464c-b891-6822a7af98e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Volume 12199525-9243-4ddc-bb25-3a8cdb32edd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12199525-9243-4ddc-bb25-3a8cdb32edd2', 'volume_size': 1} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128633657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12199525-9243-4ddc-bb25-3a8cdb32edd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:11Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Creating volume 12199525-9243-4ddc-bb25-3a8cdb32edd2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:11 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 1073741824 Sep 06 22:48:11 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:11 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD Sep 06 22:48:11 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:12 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b is fetched for user 5a818c2b83104c3792d127442c039b46. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:48:12 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 1073741824" returned: 0 in 1.010s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[981bc7a1-2b59-4408-9378-70fff50756db]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:12 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 Sep 06 22:48:12 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:12 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD Sep 06 22:48:12 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:12 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2" returned: 0 in 0.497s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:12 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f318ea48-4456-464c-b891-6822a7af98e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12199525-9243-4ddc-bb25-3a8cdb32edd2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f147199-2576-4c9d-8101-41f1ab3ffe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1054121453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d29d956-ddf3-4c11-8471-8df6c4fdfbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483e076a2f3442fabfbeb405d52f7d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:08Z,use_quota=True,user_id='5a818c2b83104c3792d127442c039b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Creating volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Volume volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 (12199525-9243-4ddc-bb25-3a8cdb32edd2): created successfully Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f147199-2576-4c9d-8101-41f1ab3ffe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:12 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1073741824 Sep 06 22:48:12 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (f5429c76-692e-4966-81d7-1969b1d4d114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-52190c51-4fc3-401b-944b-53da2c021e10 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c5f6cda-34a6-40a6-887f-02694c21a95e tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:14 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c5f6cda-34a6-40a6-887f-02694c21a95e tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2" acquired by "attach_volume" :: waited 0.048s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1073741824" returned: 0 in 1.142s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9c5f6cda-34a6-40a6-887f-02694c21a95e tempest-VolumesActionsTest-423802298 None] Attaching volume 12199525-9243-4ddc-bb25-3a8cdb32edd2 to instance 11fdfcca-cade-4627-81a2-452ab1cc0c55 at mountpoint /dev/vdb on host None. Sep 06 22:48:14 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 Sep 06 22:48:14 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9c5f6cda-34a6-40a6-887f-02694c21a95e tempest-VolumesActionsTest-423802298 None] Attach volume completed successfully. Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c5f6cda-34a6-40a6-887f-02694c21a95e tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2" released by "attach_volume" :: held 0.189s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:14 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" returned: 0 in 0.799s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:14 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Attempting download of 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c505269-68c5-4097-854a-2e94331412fa]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:15 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj Sep 06 22:48:15 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Terminate volume connection completed successfully. Sep 06 22:48:15 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj" returned: 0 in 0.507s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Detaching volume 12199525-9243-4ddc-bb25-3a8cdb32edd2 from instance 11fdfcca-cade-4627-81a2-452ab1cc0c55. Sep 06 22:48:15 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj Sep 06 22:48:15 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Detach volume completed successfully. Sep 06 22:48:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-226598ef-21c7-418d-ab4e-dc5610004826 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" released by "detach_volume" :: held 0.201s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:16 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj" returned: 1 in 0.806s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_x64keppj' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d54713-6671-43d6-964a-f00214814529]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a17bd556-92ac-4681-a0af-6f9190761f7f tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a17bd556-92ac-4681-a0af-6f9190761f7f tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a17bd556-92ac-4681-a0af-6f9190761f7f tempest-VolumesActionsTest-423802298 None] Volume detach called, but volume not attached. Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a17bd556-92ac-4681-a0af-6f9190761f7f tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:16 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD Sep 06 22:48:16 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Acquiring lock "cinder-d7a33ed6-e2aa-409e-a86f-12bedc50bb98-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:17 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] 783de45c-ba65-43ef-be94-87e88c8ed95b was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "cinder-d7a33ed6-e2aa-409e-a86f-12bedc50bb98-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:17 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 Sep 06 22:48:17 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Acquiring lock "cinder-quobyte-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "cinder-quobyte-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" acquired by "delete_volume" :: waited 0.079s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c64ec-85aa-4ca8-b830-cf98650a2a24]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-quobyte-12199525-9243-4ddc-bb25-3a8cdb32edd2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "cinder-quobyte-12199525-9243-4ddc-bb25-3a8cdb32edd2" acquired by "delete_volume" :: waited 0.065s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a90149-481a-49b9-8a27-237cb61d9090]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:18 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 Sep 06 22:48:18 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:18 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 Sep 06 22:48:18 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:19 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" returned: 0 in 2.146s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:19 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2" returned: 0 in 1.987s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:19 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98 Sep 06 22:48:19 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:19 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2 Sep 06 22:48:19 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:20 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-12199525-9243-4ddc-bb25-3a8cdb32edd2" returned: 0 in 0.872s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:20 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" returned: 0 in 1.016s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "cinder-quobyte-12199525-9243-4ddc-bb25-3a8cdb32edd2" released by "delete_volume" :: held 3.056s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "cinder-quobyte-d7a33ed6-e2aa-409e-a86f-12bedc50bb98" released by "delete_volume" :: held 3.351s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Created reservations ['c56b85af-d094-4900-a4ae-455dafd906f9', 'b46a3962-09a3-4849-900a-22538b796cf1', '08663a84-7fe1-4276-b851-626849f3756a', '2a25a732-2b14-492b-b88f-49d1b62dead3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Created reservations ['99d499c9-27b8-4df2-aca6-55dc51b961e8', '826293f1-e4c5-4e74-91f3-3423950b839f', '8b4a8918-0a87-4e4e-9068-428a128d2cc4', 'e703404b-a4d2-4d84-9788-b3529464e443'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:21 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:21 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:21 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:21 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:22 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 1.077s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:22 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.931s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Deleted volume successfully. Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e142e1ef-77ee-4126-b483-bc969d408a08 tempest-VolumesActionsTest-423802298 None] Lock "cinder-12199525-9243-4ddc-bb25-3a8cdb32edd2-delete_volume" released by "delete_volume" :: held 5.108s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Deleted volume successfully. Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e73d0315-f64e-491f-ab5d-b5ee05f329d3 tempest-ServerRescueNegativeTestJSON-357186502 None] Lock "cinder-d7a33ed6-e2aa-409e-a86f-12bedc50bb98-delete_volume" released by "delete_volume" :: held 5.530s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:22 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" returned: 0 in 5.919s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_zce63eacdevstack@QuobyteHD, size 112.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:48:22 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Converted 112.00 MB image at 18.91 MB/s Sep 06 22:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:23 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1G Sep 06 22:48:23 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:24 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 1G" returned: 0 in 1.041s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Downloaded image 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b for user 5a818c2b83104c3792d127442c039b46 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Marking volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Copying metadata from image 783de45c-ba65-43ef-be94-87e88c8ed95b to 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Creating volume glance metadata for volume 3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 backed by image 783de45c-ba65-43ef-be94-87e88c8ed95b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c779cbc9-0400-4f8f-8778-9cc859e17f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c66488-0e70-4837-8566-6cf9360252c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Volume volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 (3d29d956-ddf3-4c11-8471-8df6c4fdfbf9): created successfully Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c66488-0e70-4837-8566-6cf9360252c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Flow 'volume_create_manager' (72f6b76e-e9c4-4184-9f1c-9690e5688f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c8d18f39-76b1-4677-82d9-538e61ff741e tempest-VolumesExtendTest-870755099 None] Created volume successfully. Sep 06 22:48:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f902e19-858a-46e5-87a5-3677d59cd184]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:25 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 Sep 06 22:48:25 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:26 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" returned: 0 in 1.208s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 2G" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.565s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bf715507-b1e4-4a79-aad7-892178488e07 tempest-VolumesExtendTest-870755099 None] Extend volume completed successfully. Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "cinder-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-quobyte-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed04aca-0ba8-4caf-9fe1-10f21dca6f9d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:28 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 Sep 06 22:48:28 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (691f0879-68f9-4dd4-bbf4-0b92c7e2f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6300fd-bd45-4fc9-ac93-04e3389aaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6300fd-bd45-4fc9-ac93-04e3389aaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738374055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b248d195-816b-48f9-82e3-33c7a01c17de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:29Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a28928b-02f7-4355-b9ba-ff3d4be96db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a28928b-02f7-4355-b9ba-ff3d4be96db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac6e5f3-d36b-4b11-9a02-1ef46c351bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac6e5f3-d36b-4b11-9a02-1ef46c351bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b248d195-816b-48f9-82e3-33c7a01c17de', 'volume_name': 'volume-b248d195-816b-48f9-82e3-33c7a01c17de', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6dad5-54b7-4845-8aa3-04c8b70f9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6dad5-54b7-4845-8aa3-04c8b70f9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61974e-0eae-495f-9c29-564e6b4eb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Volume b248d195-816b-48f9-82e3-33c7a01c17de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b248d195-816b-48f9-82e3-33c7a01c17de', 'volume_size': 1} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738374055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b248d195-816b-48f9-82e3-33c7a01c17de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:29Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Creating volume b248d195-816b-48f9-82e3-33c7a01c17de {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:29 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de 1073741824 Sep 06 22:48:29 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:29 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" returned: 0 in 1.059s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:29 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9 Sep 06 22:48:29 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:30 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" returned: 0 in 0.578s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9" released by "delete_volume" :: held 1.781s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Created reservations ['342f6d04-b29a-4932-8a81-b9825ebbaf55', '082c5ea6-9609-4fe6-bb7c-36cbc77e6acb', '045d2a16-c037-42bd-b6b9-f97434a9f174', '0d52ce3b-9913-49d3-bd56-99dec5439de0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:30 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de 1073741824" returned: 0 in 0.878s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:30 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de Sep 06 22:48:30 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:30 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:30 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:30 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Deleted volume successfully. Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abb72aaa-5b16-4fa5-b14c-f71e5fbc96ea tempest-VolumesExtendTest-870755099 None] Lock "cinder-3d29d956-ddf3-4c11-8471-8df6c4fdfbf9-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:30 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de" returned: 0 in 0.520s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d61974e-0eae-495f-9c29-564e6b4eb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b248d195-816b-48f9-82e3-33c7a01c17de', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac051f8d-0493-4c3f-b0e9-ab0d5a835634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Volume volume-b248d195-816b-48f9-82e3-33c7a01c17de (b248d195-816b-48f9-82e3-33c7a01c17de): created successfully Sep 06 22:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac051f8d-0493-4c3f-b0e9-ab0d5a835634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (691f0879-68f9-4dd4-bbf4-0b92c7e2f792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d8ce9dda-fefe-41e5-a5f7-189a731bb7f4 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Flow 'volume_create_manager' (b1baaa8a-1a35-4779-8d7b-6a0712a2e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253000f-3b4e-494c-9edc-9fe94e857407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253000f-3b4e-494c-9edc-9fe94e857407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-195597969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedc216e-5603-432b-bfa2-8ecdb7be9380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483e076a2f3442fabfbeb405d52f7d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:31Z,use_quota=True,user_id='5a818c2b83104c3792d127442c039b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8f94c7-fab7-4fd3-81fe-de6f893012e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8f94c7-fab7-4fd3-81fe-de6f893012e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1562df14-4079-4c01-a312-d670c2d6f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1562df14-4079-4c01-a312-d670c2d6f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bedc216e-5603-432b-bfa2-8ecdb7be9380', 'volume_name': 'volume-bedc216e-5603-432b-bfa2-8ecdb7be9380', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c140882-8b96-4f88-ac58-1d3350082e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c140882-8b96-4f88-ac58-1d3350082e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74ccfff-e9a1-4775-a996-59b2ab9b9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Volume bedc216e-5603-432b-bfa2-8ecdb7be9380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bedc216e-5603-432b-bfa2-8ecdb7be9380', 'volume_size': 1} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-195597969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedc216e-5603-432b-bfa2-8ecdb7be9380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483e076a2f3442fabfbeb405d52f7d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:31Z,use_quota=True,user_id='5a818c2b83104c3792d127442c039b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Creating volume bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:31 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 1073741824 Sep 06 22:48:31 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-b248d195-816b-48f9-82e3-33c7a01c17de-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-b248d195-816b-48f9-82e3-33c7a01c17de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-quobyte-b248d195-816b-48f9-82e3-33c7a01c17de" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-b248d195-816b-48f9-82e3-33c7a01c17de" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcbed64-81ff-471b-aecc-3b37d0caa187]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:32 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de Sep 06 22:48:32 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:32 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 1073741824" returned: 0 in 0.539s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:32 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:32 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:32 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:32 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de Sep 06 22:48:32 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:32 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74ccfff-e9a1-4775-a996-59b2ab9b9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bedc216e-5603-432b-bfa2-8ecdb7be9380', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a0f48b-45dc-45b8-b888-7e7ff99d00ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Volume volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 (bedc216e-5603-432b-bfa2-8ecdb7be9380): created successfully Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a0f48b-45dc-45b8-b888-7e7ff99d00ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:32 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Flow 'volume_create_manager' (b1baaa8a-1a35-4779-8d7b-6a0712a2e011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b248d195-816b-48f9-82e3-33c7a01c17de" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-b248d195-816b-48f9-82e3-33c7a01c17de" released by "delete_volume" :: held 0.729s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7dd1b74d-0eae-42f2-8b8d-334bc8f0e9e9 tempest-VolumesExtendTest-870755099 None] Created volume successfully. Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Created reservations ['cdda3c4f-8c2d-4c1a-867c-b384f35a6635', '685cfa30-91c0-46da-9f7d-a15221fbcfdd', '5ee6b255-7a2c-4219-b559-95db04ec92ef', '8b30ec55-a0f9-45ac-b8f0-4cd4a065bc2c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:32 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:32 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:33 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.341s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Deleted volume successfully. Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ccafd24-3a20-4a01-b40e-f6062f1ab243 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-b248d195-816b-48f9-82e3-33c7a01c17de-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (33133e77-29be-447f-a154-9a18f1a9233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c616d9b7-5cb8-43bb-8802-26aae71123bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c616d9b7-5cb8-43bb-8802-26aae71123bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-38487432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d15e40-546a-4ede-9172-a45bdd48059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:34Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb13483-9d2f-405b-9251-52622843c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb13483-9d2f-405b-9251-52622843c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba02ee56-80d7-419f-b1fe-92fc4c15f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba02ee56-80d7-419f-b1fe-92fc4c15f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d15e40-546a-4ede-9172-a45bdd48059f', 'volume_name': 'volume-25d15e40-546a-4ede-9172-a45bdd48059f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a97720e-55d7-4099-88f2-1571741b8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a97720e-55d7-4099-88f2-1571741b8158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700cc609-8231-459b-9afd-42caf3cfb772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Volume 25d15e40-546a-4ede-9172-a45bdd48059f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d15e40-546a-4ede-9172-a45bdd48059f', 'volume_size': 1} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-38487432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d15e40-546a-4ede-9172-a45bdd48059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:34Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Creating volume 25d15e40-546a-4ede-9172-a45bdd48059f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:33 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:33 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f 1073741824 Sep 06 22:48:33 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:34 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f 1073741824" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:34 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f Sep 06 22:48:34 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:34 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700cc609-8231-459b-9afd-42caf3cfb772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d15e40-546a-4ede-9172-a45bdd48059f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd17018f-f96e-4419-bd2e-878883d57b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Creating offline snapshot f4314f1d-6c66-41c8-b10a-cb66cdfcc6af of volume bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:48:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Volume volume-25d15e40-546a-4ede-9172-a45bdd48059f (25d15e40-546a-4ede-9172-a45bdd48059f): created successfully Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd17018f-f96e-4419-bd2e-878883d57b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (33133e77-29be-447f-a154-9a18f1a9233e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b40ae9-abc6-4418-90b8-2d2446dab4f3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ee5f9cbe-32f2-4ce7-82d3-ad36f7a8ae76 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:34 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:34 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:35 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:35 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af 1G Sep 06 22:48:35 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:35 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af 1G" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:35 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af Sep 06 22:48:35 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-25d15e40-546a-4ede-9172-a45bdd48059f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-25d15e40-546a-4ede-9172-a45bdd48059f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-quobyte-25d15e40-546a-4ede-9172-a45bdd48059f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-25d15e40-546a-4ede-9172-a45bdd48059f" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ac1e4-10d5-40a4-ab32-dff0d3ce47d7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:36 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" returned: 0 in 0.538s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af is being set with open permissions: ugo+rw Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:36 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af Sep 06 22:48:36 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:36 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f Sep 06 22:48:36 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:36 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:36 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info Sep 06 22:48:36 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:36 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f" returned: 0 in 0.429s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:36 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f Sep 06 22:48:36 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:36 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info is being set with open permissions: ugo+rw Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:36 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info Sep 06 22:48:36 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:36 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25d15e40-546a-4ede-9172-a45bdd48059f" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-25d15e40-546a-4ede-9172-a45bdd48059f" released by "delete_volume" :: held 0.788s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Created reservations ['621c5acc-37ad-43e7-af4d-815e73fbfa86', '904eef71-f388-4c5a-9529-1cdb7cf8adce', 'd43cfd3e-b0f7-41db-a9d2-1761bf557c94', '06f6d269-2ed4-433e-998f-bf5e73c7163b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:37 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:37 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:37 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.info" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8b5d22e0-3335-427c-abf4-b6fd036c4dbf tempest-VolumesExtendTest-870755099 None] Create snapshot completed successfully Sep 06 22:48:37 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Deleted volume successfully. Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-20f5c504-7318-4b2f-b209-9b48376cc707 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-25d15e40-546a-4ede-9172-a45bdd48059f-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (37f8466c-c706-453e-a71a-00d182c12a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ef7f74-df7f-4177-a284-969f6eb4a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ef7f74-df7f-4177-a284-969f6eb4a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884643667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63652dbb-b6ed-443a-9fb3-169e2ccd3477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:38Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd151b88-b463-4739-b2cf-710b9e0a3de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd151b88-b463-4739-b2cf-710b9e0a3de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2a925-0ff8-4574-b714-5857477d0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2a925-0ff8-4574-b714-5857477d0d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63652dbb-b6ed-443a-9fb3-169e2ccd3477', 'volume_name': 'volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a8c6cf-c5ab-4971-b772-8acfdcc8b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a8c6cf-c5ab-4971-b772-8acfdcc8b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7f083d-17a0-4ac3-b54d-3d7c16a32f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Volume 63652dbb-b6ed-443a-9fb3-169e2ccd3477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477', 'volume_size': 1} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884643667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63652dbb-b6ed-443a-9fb3-169e2ccd3477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:38Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Creating volume 63652dbb-b6ed-443a-9fb3-169e2ccd3477 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:37 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 1073741824 Sep 06 22:48:37 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:38 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 1073741824" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:38 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 Sep 06 22:48:38 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:38 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.390s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[819938b2-1d81-4ab0-a385-e511dbe5bc3a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7f083d-17a0-4ac3-b54d-3d7c16a32f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f7f0c9-b8f7-43b0-8a53-77cc35fc7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Volume volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 (63652dbb-b6ed-443a-9fb3-169e2ccd3477): created successfully Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f7f0c9-b8f7-43b0-8a53-77cc35fc7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (37f8466c-c706-453e-a71a-00d182c12a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a0309b1f-4daf-48ef-9001-a23656f693d0 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:38 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:38 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:39 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af 2G" returned: 0 in 0.121s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.564s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cdb9e113-6445-4e9f-abd7-4f3fcb90a567 tempest-VolumesExtendTest-870755099 None] Extend volume completed successfully. Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-quobyte-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Deleting offline snapshot f4314f1d-6c66-41c8-b10a-cb66cdfcc6af of volume bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] snapshot_file for this snap is: volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532828a-f2c5-46f6-8446-ca03682e1bbf]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:39 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af Sep 06 22:48:39 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-63652dbb-b6ed-443a-9fb3-169e2ccd3477-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:40 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bedc216e-5603-432b-bfa2-8ecdb7be9380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-63652dbb-b6ed-443a-9fb3-169e2ccd3477-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4d39b-74b2-464c-8231-ebbb89836b35]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-quobyte-63652dbb-b6ed-443a-9fb3-169e2ccd3477" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-63652dbb-b6ed-443a-9fb3-169e2ccd3477" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1937e2d-7c8c-42be-898e-8566378790cc]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:40 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:40 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:40 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 Sep 06 22:48:40 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:40 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.397s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:40 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af Sep 06 22:48:40 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:40 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:40 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477 Sep 06 22:48:40 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:40 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-63652dbb-b6ed-443a-9fb3-169e2ccd3477" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-63652dbb-b6ed-443a-9fb3-169e2ccd3477" released by "delete_volume" :: held 0.771s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:40 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" returned: 0 in 0.476s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Created reservations ['d2658f6f-ec2b-446e-8b1e-2e45c76eaaf9', 'c39ddb47-bfe3-4bc8-b256-3865b946acc5', '4e25a5f2-ac30-4108-8b97-4514ff7f0b74', '450f8718-27c7-46cd-81b8-a77a703eb8fa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:40 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af Sep 06 22:48:40 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:41 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:41 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:41 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380.f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af" released by "_delete_snapshot" :: held 1.755s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" released by "delete_snapshot" :: held 1.783s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:41 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Created reservations ['eef59f07-c610-4d21-8e43-3583accadcc8', '74d2b441-21bf-474d-a1af-177b6c2c6e12', '8716e4a1-5552-42fa-9c5d-d2ab5a1dbe6f', 'a96aa093-9b28-4638-86c3-80f4937c1ad7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Deleted volume successfully. Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f827cdb1-c16a-4346-8df2-a99b7923f0f7 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-63652dbb-b6ed-443a-9fb3-169e2ccd3477-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Delete snapshot completed successfully. Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbbcbb9f-50b6-46f1-905b-5e76008398d1 tempest-VolumesExtendTest-870755099 None] Lock "cinder-f4314f1d-6c66-41c8-b10a-cb66cdfcc6af-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-bedc216e-5603-432b-bfa2-8ecdb7be9380-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "cinder-bedc216e-5603-432b-bfa2-8ecdb7be9380-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Acquiring lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (b61356be-5740-4175-a154-9bf15ea173ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d0ca14-eae7-471c-92db-6507ad2e022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d0ca14-eae7-471c-92db-6507ad2e022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401451042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f297fc-bf89-4db0-8e47-0cc36f19bda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:42Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5500dc9e-584c-498f-af90-cf94002b9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5500dc9e-584c-498f-af90-cf94002b9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d12fe2-7060-4d85-a0a7-8b883606c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d12fe2-7060-4d85-a0a7-8b883606c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f297fc-bf89-4db0-8e47-0cc36f19bda0', 'volume_name': 'volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3a2c47-f3ab-48b7-9ba7-4eedea0d1806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3a2c47-f3ab-48b7-9ba7-4eedea0d1806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a218e70-fb72-436f-920b-552a691411c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Volume 11f297fc-bf89-4db0-8e47-0cc36f19bda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0', 'volume_size': 1} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401451042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f297fc-bf89-4db0-8e47-0cc36f19bda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:42Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Creating volume 11f297fc-bf89-4db0-8e47-0cc36f19bda0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:42 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1450dd0-b429-4c49-b072-f0237aceab0c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:42 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 1073741824 Sep 06 22:48:42 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:42 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:42 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:42 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.389s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:42 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380 Sep 06 22:48:42 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:42 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 1073741824" returned: 0 in 0.472s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:42 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 Sep 06 22:48:42 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:42 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-bedc216e-5603-432b-bfa2-8ecdb7be9380" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "cinder-quobyte-bedc216e-5603-432b-bfa2-8ecdb7be9380" released by "delete_volume" :: held 0.785s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Created reservations ['fbae335b-4628-4781-8516-de6ee045cd91', '756af668-9e57-4337-8f12-7eee7e4905c9', '068d396e-ba69-4c3d-9b4c-c3e49adfa44f', 'd4b29fc7-1c9a-4c60-841b-71ee3551b1e8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:42 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a218e70-fb72-436f-920b-552a691411c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f760cb4-ed13-4cf1-8e94-89498716a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Volume volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 (11f297fc-bf89-4db0-8e47-0cc36f19bda0): created successfully Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f760cb4-ed13-4cf1-8e94-89498716a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (b61356be-5740-4175-a154-9bf15ea173ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6776514e-261d-4913-a006-c99227636738 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:43 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:43 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:43 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.341s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Deleted volume successfully. Sep 06 22:48:43 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=132,cinder:SELECT=106,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:48:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4868305-3d4b-447b-b169-f6218820d4eb tempest-VolumesExtendTest-870755099 None] Lock "cinder-bedc216e-5603-432b-bfa2-8ecdb7be9380-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-11f297fc-bf89-4db0-8e47-0cc36f19bda0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-11f297fc-bf89-4db0-8e47-0cc36f19bda0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=111,cinder:SELECT=91,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "cinder-quobyte-11f297fc-bf89-4db0-8e47-0cc36f19bda0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-11f297fc-bf89-4db0-8e47-0cc36f19bda0" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6374973d-5a8e-419d-8691-86d99603df0e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:44 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 Sep 06 22:48:44 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:44 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:44 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0 Sep 06 22:48:44 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:45 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11f297fc-bf89-4db0-8e47-0cc36f19bda0" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-quobyte-11f297fc-bf89-4db0-8e47-0cc36f19bda0" released by "delete_volume" :: held 0.888s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Created reservations ['b0991548-9b3a-4a16-87ee-021a83204b41', '94dc686a-e04a-4151-982f-bfefdb662b9e', '98c2e860-777a-4477-97be-bcdaf58a8728', '0a6eb2b6-ec2c-45df-bae3-d793a398a1a5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:45 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:45 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:45 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Deleted volume successfully. Sep 06 22:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0657d4c-19b3-4f10-b269-1afc115c6520 tempest-VolumesActionsTest-1803348150 None] Lock "cinder-11f297fc-bf89-4db0-8e47-0cc36f19bda0-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (d76142c7-917e-4a9a-a74c-fbd607f8f37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03af363f-fbc2-4c5a-9997-c463155a5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03af363f-fbc2-4c5a-9997-c463155a5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646470512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c58180-b700-46b3-a09c-3fad0712b09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:46Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d11831-f459-450f-9a4a-7d485c02b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d11831-f459-450f-9a4a-7d485c02b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdaaeca-2511-4695-9e91-b3629270c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdaaeca-2511-4695-9e91-b3629270c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c58180-b700-46b3-a09c-3fad0712b09d', 'volume_name': 'volume-a5c58180-b700-46b3-a09c-3fad0712b09d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e947e5e0-9ce8-4e82-9c00-4f448a4f8ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e947e5e0-9ce8-4e82-9c00-4f448a4f8ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199cda28-dffc-4a62-be1d-07db8435f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Volume a5c58180-b700-46b3-a09c-3fad0712b09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c58180-b700-46b3-a09c-3fad0712b09d', 'volume_size': 1} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646470512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c58180-b700-46b3-a09c-3fad0712b09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105c162420734172b307c69dd963cf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:46Z,use_quota=True,user_id='c951ced3c03b43b2901b122f78c83163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Creating volume a5c58180-b700-46b3-a09c-3fad0712b09d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:46 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d 1073741824 Sep 06 22:48:46 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:47 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d 1073741824" returned: 0 in 0.611s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:47 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d Sep 06 22:48:47 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:47 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199cda28-dffc-4a62-be1d-07db8435f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c58180-b700-46b3-a09c-3fad0712b09d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67260e3f-69f4-453a-b15a-799cda9ab39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Volume volume-a5c58180-b700-46b3-a09c-3fad0712b09d (a5c58180-b700-46b3-a09c-3fad0712b09d): created successfully Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67260e3f-69f4-453a-b15a-799cda9ab39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Flow 'volume_create_manager' (d76142c7-917e-4a9a-a74c-fbd607f8f37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4af0957d-e4cf-4764-8c62-c93acde93660 tempest-VolumesActionsTest-423802298 None] Created volume successfully. Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (fb53ff83-2b33-4a8b-8cf7-033c0377c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56128019-47ec-4cd3-848d-063761ef242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56128019-47ec-4cd3-848d-063761ef242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814233164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0cc7a6-8a09-44ca-8471-9a0728307cc2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:48Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75fdab-ffb5-43d1-958b-5f5a5c22c56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75fdab-ffb5-43d1-958b-5f5a5c22c56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99e37be-3684-4d52-af62-9915a360c870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99e37be-3684-4d52-af62-9915a360c870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0cc7a6-8a09-44ca-8471-9a0728307cc2', 'volume_name': 'volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a7f3c6-e260-404b-9833-b94817ecb4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a7f3c6-e260-404b-9833-b94817ecb4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192b37f1-37e2-407e-9583-29acdbe411af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Volume ed0cc7a6-8a09-44ca-8471-9a0728307cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2', 'volume_size': 1} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-814233164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0cc7a6-8a09-44ca-8471-9a0728307cc2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:48Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Creating volume ed0cc7a6-8a09-44ca-8471-9a0728307cc2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:48 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:48 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 1073741824 Sep 06 22:48:48 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:49 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 1073741824" returned: 0 in 0.756s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:49 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 Sep 06 22:48:49 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:49 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192b37f1-37e2-407e-9583-29acdbe411af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a6e79c-10eb-4602-9d45-8c40e11c21f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Volume volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 (ed0cc7a6-8a09-44ca-8471-9a0728307cc2): created successfully Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a6e79c-10eb-4602-9d45-8c40e11c21f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (fb53ff83-2b33-4a8b-8cf7-033c0377c275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4f4723b1-5316-4f61-9bb5-7ce0e7370a21 tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-a5c58180-b700-46b3-a09c-3fad0712b09d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "cinder-a5c58180-b700-46b3-a09c-3fad0712b09d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Acquiring lock "cinder-quobyte-a5c58180-b700-46b3-a09c-3fad0712b09d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "cinder-quobyte-a5c58180-b700-46b3-a09c-3fad0712b09d" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e9699-f2f4-4c02-abb4-f743c7276435]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:49 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d Sep 06 22:48:49 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:50 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:50 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d Sep 06 22:48:50 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:50 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a5c58180-b700-46b3-a09c-3fad0712b09d" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "cinder-quobyte-a5c58180-b700-46b3-a09c-3fad0712b09d" released by "delete_volume" :: held 1.114s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Created reservations ['60f1c650-c946-4f9c-9084-e2978731c334', 'ecfc4281-153e-4a6f-a1ba-1e5c990f649d', '6aa7875b-245b-49cd-9cb2-0250fd6861cf', '48b8e793-38bb-4d37-9d7c-a6f9de3ea8f5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:51 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:51 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:51 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (6050af36-3150-4c41-b417-af0812479f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebc1ea8-a9f9-41cb-8943-9fde799b54f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Deleted volume successfully. Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebc1ea8-a9f9-41cb-8943-9fde799b54f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317808696',display_name='tempest-VolumesGetTest-Volume-440091218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0463905-2eb2-4f65-ba24-2596dc9677c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:51Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3239b38-37c2-4e80-bdf5-356004dcbc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3239b38-37c2-4e80-bdf5-356004dcbc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa52a189-67d6-44a4-8b93-ecfb3f15e341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa52a189-67d6-44a4-8b93-ecfb3f15e341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0463905-2eb2-4f65-ba24-2596dc9677c1', 'volume_name': 'volume-a0463905-2eb2-4f65-ba24-2596dc9677c1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb860ac6-baab-4b66-8676-127e724f30e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb860ac6-baab-4b66-8676-127e724f30e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b403c9d-4923-44d0-a821-b2288f6fcc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Volume a0463905-2eb2-4f65-ba24-2596dc9677c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0463905-2eb2-4f65-ba24-2596dc9677c1', 'volume_size': 1} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317808696',display_name='tempest-VolumesGetTest-Volume-440091218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0463905-2eb2-4f65-ba24-2596dc9677c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:51Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Creating volume a0463905-2eb2-4f65-ba24-2596dc9677c1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:51 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 1073741824 Sep 06 22:48:51 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-95d19d01-fd1c-4b48-a7e2-0c1e594a6fa2 tempest-VolumesActionsTest-423802298 None] Lock "cinder-a5c58180-b700-46b3-a09c-3fad0712b09d-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:52 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 1073741824" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:52 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 Sep 06 22:48:52 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:52 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b403c9d-4923-44d0-a821-b2288f6fcc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0463905-2eb2-4f65-ba24-2596dc9677c1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563cfadb-8010-4bdc-8923-071012bc2efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Volume volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 (a0463905-2eb2-4f65-ba24-2596dc9677c1): created successfully Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563cfadb-8010-4bdc-8923-071012bc2efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (6050af36-3150-4c41-b417-af0812479f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c2b5d809-ac75-4604-aeeb-7bf649c21613 tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:48:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-a0463905-2eb2-4f65-ba24-2596dc9677c1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "cinder-a0463905-2eb2-4f65-ba24-2596dc9677c1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-a0463905-2eb2-4f65-ba24-2596dc9677c1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-a0463905-2eb2-4f65-ba24-2596dc9677c1" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[09291a0d-3b57-4cba-b57b-d3ea4fcdfd44]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:54 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 Sep 06 22:48:54 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:54 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:54 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1 Sep 06 22:48:54 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:54 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0463905-2eb2-4f65-ba24-2596dc9677c1" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-a0463905-2eb2-4f65-ba24-2596dc9677c1" released by "delete_volume" :: held 0.934s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Created reservations ['2de28f1d-3c5a-4831-9bc2-6130f88a2f5d', '41c44812-3b06-4cfb-9b3f-45f755a98b65', 'd34a17d9-7639-41fc-8bb0-8176d8c3bb9c', 'c693542b-5e0a-44c9-9e30-7721c6c1bad5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:55 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:55 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:55 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:48:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-27f42016-fd11-42b0-a53e-0dc27b345139 tempest-VolumesGetTest-1539608732 None] Lock "cinder-a0463905-2eb2-4f65-ba24-2596dc9677c1-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-9f67f111-14ce-48ca-80d2-573def8bf06f req-caa50683-9797-48d8-accc-2d86f0221a51 tempest-AttachVolumeNegativeTest-1990295743 None] Terminate volume connection completed successfully. Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-9f67f111-14ce-48ca-80d2-573def8bf06f req-caa50683-9797-48d8-accc-2d86f0221a51 tempest-AttachVolumeNegativeTest-1990295743 None] Deleting attachment b3554dc8-d5dc-45bc-b378-105dbc854f53. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-ed0cc7a6-8a09-44ca-8471-9a0728307cc2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "cinder-ed0cc7a6-8a09-44ca-8471-9a0728307cc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[76feb566-efae-4cef-8ab1-da4764de233c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:56 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 Sep 06 22:48:56 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:57 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" returned: 0 in 0.616s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:57 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2 Sep 06 22:48:57 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:57 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-ed0cc7a6-8a09-44ca-8471-9a0728307cc2" released by "delete_volume" :: held 0.996s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Created reservations ['c8043d69-6bdd-41bf-b468-d8ac15cb5e86', 'f4e29179-ec24-47b3-922d-e55e1e15a3da', '89e92a2a-14e5-4047-916a-ccf5774d5142', 'c3c3e67a-57d5-4b2a-b5a9-a5fa6180cf06'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:57 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:48:57 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:58 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:48:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:48:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:48:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f9ba7be9-d4db-470e-8763-5a07c7f6de98 tempest-VolumesGetTest-1539608732 None] Lock "cinder-ed0cc7a6-8a09-44ca-8471-9a0728307cc2-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (8d0d3a35-7a42-4e53-a667-14403c50dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d721a288-53b7-4fb6-a720-f6987e2ee028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d721a288-53b7-4fb6-a720-f6987e2ee028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1543359855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeac7cb-1885-4c27-ad58-1b815eb0aee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:59Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31271fcd-4c4b-40cf-8081-be1abb3ac249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31271fcd-4c4b-40cf-8081-be1abb3ac249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fcb55e-3ccb-411c-9f05-2140f7d7f3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fcb55e-3ccb-411c-9f05-2140f7d7f3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'volume_name': 'volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b2bb88-e5de-42e2-a6a4-98d8042be6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b2bb88-e5de-42e2-a6a4-98d8042be6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1480693c-1aaa-4e44-8de0-4c35a3f9723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:48:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Volume 2aeac7cb-1885-4c27-ad58-1b815eb0aee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'volume_size': 1} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1543359855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeac7cb-1885-4c27-ad58-1b815eb0aee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:48:59Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Creating volume 2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:48:59 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:48:59 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 1073741824 Sep 06 22:48:59 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:48:59 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 06 22:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 1073741824" returned: 0 in 0.555s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:00 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:00 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:00 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1480693c-1aaa-4e44-8de0-4c35a3f9723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc2cb15-fef1-4c1f-b65e-7bc0774eedb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Volume volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 (2aeac7cb-1885-4c27-ad58-1b815eb0aee2): created successfully Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc2cb15-fef1-4c1f-b65e-7bc0774eedb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (8d0d3a35-7a42-4e53-a667-14403c50dd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d72ad58a-97d4-4024-9640-b9250636e0f5 tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (53807c4b-9f3d-4688-84e2-6f1b41ffa6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f19eaf-f92c-46c0-9a96-a96b00feb6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f19eaf-f92c-46c0-9a96-a96b00feb6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-242606133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5375b3-d2be-4d8d-a6da-6c2829d18030,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2aeac7cb-1885-4c27-ad58-1b815eb0aee2,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:02Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb9cb6f-67fa-4206-8db9-a85d9e106103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb9cb6f-67fa-4206-8db9-a85d9e106103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9c12b-fd4b-44ba-a42b-8790b365653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9c12b-fd4b-44ba-a42b-8790b365653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e5375b3-d2be-4d8d-a6da-6c2829d18030', 'volume_name': 'volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030', 'volume_size': 1, 'source_volid': '2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0ba4ee-9207-4ca8-a013-7b243316b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0ba4ee-9207-4ca8-a013-7b243316b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ec7df8-d7c7-430c-8653-7401b95ea47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Volume 4e5375b3-d2be-4d8d-a6da-6c2829d18030: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030', 'volume_size': 1, 'source_volid': '2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'source_volstatus': 'available'} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:02 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Cloning volume 2aeac7cb-1885-4c27-ad58-1b815eb0aee2 to volume 4e5375b3-d2be-4d8d-a6da-6c2829d18030 Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Creating offline snapshot 491b6644-a515-460a-a54a-8d3b0d52bc74 of volume 2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0836d2a5-3f32-46c5-9194-95864160bd4c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:02 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:02 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:02 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:03 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 1G Sep 06 22:49:03 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:03 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 1G" returned: 0 in 0.610s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:03 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:03 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:04 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:04 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 is being set with open permissions: ugo+rw Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:04 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:04 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:04 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:04 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info Sep 06 22:49:04 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:04 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:04 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info is being set with open permissions: ugo+rw Sep 06 22:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:04 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info Sep 06 22:49:04 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:05 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.info" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] snapshot: 491b6644-a515-460a-a54a-8d3b0d52bc74, volume: 4e5375b3-d2be-4d8d-a6da-6c2829d18030, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf0311-2e59-4495-94a1-3b0ed9886fd9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:05 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:05 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:05 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4f3920-7d0b-4259-8a04-cb6f0e30ef7e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:05 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:05 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:05 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:05 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:06 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:49:06 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:06 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 Sep 06 22:49:06 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:14 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=31,cinder:UPDATE=44,cinder:DELETE=8,cinder:INSERT=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:49:14 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=46,cinder:SELECT=34,cinder:INSERT=15 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:49:14 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030" returned: 0 in 8.744s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:49:14 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Converted 1024.00 MB image at 117.01 MB/s Sep 06 22:49:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 is being set with open permissions: ugo+rw Sep 06 22:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:14 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 Sep 06 22:49:14 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:15 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" released by "_copy_volume_from_snapshot" :: held 10.305s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-491b6644-a515-460a-a54a-8d3b0d52bc74" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-491b6644-a515-460a-a54a-8d3b0d52bc74" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Deleting offline snapshot 491b6644-a515-460a-a54a-8d3b0d52bc74 of volume 2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] snapshot_file for this snap is: volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1958e5-fd22-4db0-ae7b-2ced879a0d34]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:15 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:15 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:16 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.667s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd5df3-46ef-44dc-9f9e-4fd60b0c144a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:16 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:16 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Flow 'volume_create_manager' (1d4d9e90-d551-4366-a438-844fdfb36405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ab938-009a-4ce7-a435-fd2eeb8be9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ab938-009a-4ce7-a435-fd2eeb8be9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-74323734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cba6b1-41f2-40ff-8201-fc16c11c50d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907401664e47419788ded9ccc95e3ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:17Z,use_quota=True,user_id='1d02faa87c0b4b67b5b60e92e9904926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfa24a4-1ddf-413a-bc15-df2a715f2777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfa24a4-1ddf-413a-bc15-df2a715f2777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c134373a-865d-403e-be0c-028f7ed3c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:49:17 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 1.194s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:17 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:17 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c134373a-865d-403e-be0c-028f7ed3c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25cba6b1-41f2-40ff-8201-fc16c11c50d7', 'volume_name': 'volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e9025b-3a9a-4be1-8651-c56c93db00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e9025b-3a9a-4be1-8651-c56c93db00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d2fdb2-6bc3-4bb4-9585-16c72cdf130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 22:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Trying to clone 25cba6b1-41f2-40ff-8201-fc16c11c50d7 from image 783de45c-ba65-43ef-be94-87e88c8ed95b at location (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:49:18 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.711s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:18 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74 Sep 06 22:49:18 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:49:18 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Image download 20.69 MB at 20.69 MB/s Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[112856ab-8c5e-4857-a906-e90084a87f22]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:18 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2.491b6644-a515-460a-a54a-8d3b0d52bc74" returned: 0 in 0.403s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-491b6644-a515-460a-a54a-8d3b0d52bc74" released by "_delete_snapshot" :: held 3.163s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:18 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD Sep 06 22:49:18 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.316s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ec7df8-d7c7-430c-8653-7401b95ea47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030', 'volume_size': 1, 'source_volid': '2aeac7cb-1885-4c27-ad58-1b815eb0aee2', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3304632-e5b1-438c-a51b-96dc656ae940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Volume volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 (4e5375b3-d2be-4d8d-a6da-6c2829d18030): created successfully Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3304632-e5b1-438c-a51b-96dc656ae940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (53807c4b-9f3d-4688-84e2-6f1b41ffa6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f08ef05e-9373-4e85-b0d5-4fdc0215b5cd tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:49:19 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b is fetched for user 1d02faa87c0b4b67b5b60e92e9904926. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb6038-2a6d-4160-88f3-a54fa46cd336]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:19 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD Sep 06 22:49:19 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:19 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-74323734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cba6b1-41f2-40ff-8201-fc16c11c50d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907401664e47419788ded9ccc95e3ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:17Z,use_quota=True,user_id='1d02faa87c0b4b67b5b60e92e9904926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Creating volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:19 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:19 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1073741824 Sep 06 22:49:19 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:20 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1073741824" returned: 0 in 0.930s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:20 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 Sep 06 22:49:20 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:21 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7" returned: 0 in 0.611s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Attempting download of 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88804520-d4fe-4317-9ab9-ecc948267994]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:21 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t Sep 06 22:49:21 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (1dc66860-b018-46b7-a068-bde49be475f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc43193-b221-47bd-ac5b-c861f23e7d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc43193-b221-47bd-ac5b-c861f23e7d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2091331405',display_name='tempest-VolumesGetTest-Volume-1918611754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aab3641-df58-4c83-b690-0fec3e93f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:22Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1f58d0-424b-444f-bb51-059309e09e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1f58d0-424b-444f-bb51-059309e09e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5abf37-3501-4217-aa1d-902900c480e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5abf37-3501-4217-aa1d-902900c480e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aab3641-df58-4c83-b690-0fec3e93f667', 'volume_name': 'volume-6aab3641-df58-4c83-b690-0fec3e93f667', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b569f-3ba2-4bca-be34-cb4c1745cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b569f-3ba2-4bca-be34-cb4c1745cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c087b-c757-4e61-b863-04d267a5d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Volume 6aab3641-df58-4c83-b690-0fec3e93f667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aab3641-df58-4c83-b690-0fec3e93f667', 'volume_size': 1} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2091331405',display_name='tempest-VolumesGetTest-Volume-1918611754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aab3641-df58-4c83-b690-0fec3e93f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:22Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Creating volume 6aab3641-df58-4c83-b690-0fec3e93f667 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:22 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 1073741824 Sep 06 22:49:22 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:22 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t" returned: 0 in 0.768s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:22 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t Sep 06 22:49:22 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:22 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 1073741824" returned: 0 in 0.738s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:22 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 Sep 06 22:49:22 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:22 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t" returned: 1 in 0.692s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_etjozo2t' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db308ad-4dc2-4be7-93c9-9a882754cb4a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:23 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD Sep 06 22:49:23 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:23 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667" returned: 0 in 0.577s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8c087b-c757-4e61-b863-04d267a5d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aab3641-df58-4c83-b690-0fec3e93f667', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903d80de-8e34-48d9-a7cb-56288f32c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Volume volume-6aab3641-df58-4c83-b690-0fec3e93f667 (6aab3641-df58-4c83-b690-0fec3e93f667): created successfully Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903d80de-8e34-48d9-a7cb-56288f32c15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (1dc66860-b018-46b7-a068-bde49be475f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e2c1acbb-f651-4abb-839e-eff85d6ba8f5 tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:49:23 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] 783de45c-ba65-43ef-be94-87e88c8ed95b was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:23 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 Sep 06 22:49:23 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-6aab3641-df58-4c83-b690-0fec3e93f667-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "cinder-6aab3641-df58-4c83-b690-0fec3e93f667-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-6aab3641-df58-4c83-b690-0fec3e93f667" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-6aab3641-df58-4c83-b690-0fec3e93f667" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47e262-a52a-4bcc-ae13-64fcbccf1edd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:24 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 Sep 06 22:49:24 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:24 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667" returned: 0 in 0.506s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:24 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667 Sep 06 22:49:24 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:25 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6aab3641-df58-4c83-b690-0fec3e93f667" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-6aab3641-df58-4c83-b690-0fec3e93f667" released by "delete_volume" :: held 0.971s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Created reservations ['6f797d22-8869-42e8-a817-dda9e9e8acca', '5ac1da33-cac2-478a-87ad-75ff9e84f2b9', 'ce239d2d-76c9-4c77-b1d3-5115c5164e01', '748c067f-7bfb-462e-ae99-c739a83c19c6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:25 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:25 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:25 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cef7aae-f6e6-4e88-bc7e-b6bcd714b6aa tempest-VolumesGetTest-1539608732 None] Lock "cinder-6aab3641-df58-4c83-b690-0fec3e93f667-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:25 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7" returned: 0 in 2.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_pbgloecmdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:49:25 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Converted 112.00 MB image at 48.66 MB/s Sep 06 22:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:25 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1G Sep 06 22:49:25 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:26 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 1G" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Downloaded image 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b for user 1d02faa87c0b4b67b5b60e92e9904926 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Marking volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Copying metadata from image 783de45c-ba65-43ef-be94-87e88c8ed95b to 25cba6b1-41f2-40ff-8201-fc16c11c50d7. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Creating volume glance metadata for volume 25cba6b1-41f2-40ff-8201-fc16c11c50d7 backed by image 783de45c-ba65-43ef-be94-87e88c8ed95b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d2fdb2-6bc3-4bb4-9585-16c72cdf130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1567552-a680-4f1e-92f4-657d5567e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Volume volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 (25cba6b1-41f2-40ff-8201-fc16c11c50d7): created successfully Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1567552-a680-4f1e-92f4-657d5567e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Flow 'volume_create_manager' (1d4d9e90-d551-4366-a438-844fdfb36405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5ca8697f-dbe0-4018-9b6f-b3cf1fd1ad11 tempest-VolumesImageMetadata-646974906 None] Created volume successfully. Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-4e5375b3-d2be-4d8d-a6da-6c2829d18030-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "cinder-4e5375b3-d2be-4d8d-a6da-6c2829d18030-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d2b97-d1a0-4f4a-a8f6-aa869faef811]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:26 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 Sep 06 22:49:26 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:26 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:26 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030 Sep 06 22:49:26 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:27 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4e5375b3-d2be-4d8d-a6da-6c2829d18030" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4e5375b3-d2be-4d8d-a6da-6c2829d18030" released by "delete_volume" :: held 0.741s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Created reservations ['074316fd-10b7-41ac-99ce-040dbe569448', '26d3cf85-af53-4d67-b177-f072f561adc6', '410a0fe5-639c-4421-8f5b-dd79e8f68b24', 'ebb16865-a442-4a9f-8463-c46199dae846'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:27 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:27 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:27 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Acquiring lock "cinder-25cba6b1-41f2-40ff-8201-fc16c11c50d7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-2aeac7cb-1885-4c27-ad58-1b815eb0aee2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "cinder-25cba6b1-41f2-40ff-8201-fc16c11c50d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "cinder-2aeac7cb-1885-4c27-ad58-1b815eb0aee2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-082400ad-4970-4a4a-b6c3-bfc6018b0239 tempest-VolumesGetTest-1539608732 None] Lock "cinder-4e5375b3-d2be-4d8d-a6da-6c2829d18030-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Acquiring lock "cinder-quobyte-25cba6b1-41f2-40ff-8201-fc16c11c50d7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "cinder-quobyte-25cba6b1-41f2-40ff-8201-fc16c11c50d7" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[64495d8b-ccf6-40bf-aed0-437338bdd676]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3ec92-d6ad-4e90-bf02-c4507282def9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:28 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 Sep 06 22:49:28 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:28 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:28 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:28 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:28 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7 Sep 06 22:49:28 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:28 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:28 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2 Sep 06 22:49:28 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:28 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-25cba6b1-41f2-40ff-8201-fc16c11c50d7" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "cinder-quobyte-25cba6b1-41f2-40ff-8201-fc16c11c50d7" released by "delete_volume" :: held 0.683s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Created reservations ['0450ce8c-32df-4448-9a86-e40a47354b9d', 'f4017e9f-0aeb-412c-908e-42fee5bd45d7', '852b102a-0317-4f90-94d5-2136ce1a452a', '007b7eb9-a3ed-4f0a-9641-479b58cd73a9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:28 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-2aeac7cb-1885-4c27-ad58-1b815eb0aee2" released by "delete_volume" :: held 0.748s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:28 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:28 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Created reservations ['8e058ed1-d56f-4e7b-8c23-5595b7b4e79e', 'c1976feb-b3a4-4c2d-85e2-8de2c98134a6', 'd7d4e15d-ee5c-4ec9-ab1f-b0518ea71bc1', '9d27dc77-0c90-404f-b587-6f1aca299a03'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:28 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:28 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:29 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Deleted volume successfully. Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-72ff0f1f-dcc4-4ca5-bc90-15e3b7d98667 tempest-VolumesImageMetadata-646974906 None] Lock "cinder-25cba6b1-41f2-40ff-8201-fc16c11c50d7-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:29 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f1cdac3-43ea-4de4-8ee3-679df1995bcb tempest-VolumesGetTest-1539608732 None] Lock "cinder-2aeac7cb-1885-4c27-ad58-1b815eb0aee2-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (48c4ef9a-245c-4408-89d0-46b92d4728f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fde5c85-7fdc-4755-a77f-d34b7a4da47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fde5c85-7fdc-4755-a77f-d34b7a4da47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-392112872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a801ce4-1747-4d73-8e74-704c658d1ff5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:30Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d4eec-8a32-4213-8d13-b4b26ef16b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d4eec-8a32-4213-8d13-b4b26ef16b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fb73e9-0b49-44a8-acad-3d701cec60ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:29 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:49:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fb73e9-0b49-44a8-acad-3d701cec60ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a801ce4-1747-4d73-8e74-704c658d1ff5', 'volume_name': 'volume-4a801ce4-1747-4d73-8e74-704c658d1ff5', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3919e1-5ac6-40ab-9a25-9617bbfed2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3919e1-5ac6-40ab-9a25-9617bbfed2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cc6d8c-d471-4251-b2f4-047ceac608ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Volume 4a801ce4-1747-4d73-8e74-704c658d1ff5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a801ce4-1747-4d73-8e74-704c658d1ff5', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 22:49:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Trying to clone 4a801ce4-1747-4d73-8e74-704c658d1ff5 from image 783de45c-ba65-43ef-be94-87e88c8ed95b at location (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:49:31 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Image download 20.69 MB at 20.69 MB/s Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c018a2-63ce-4f72-91c3-ded8f7526882]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:31 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD Sep 06 22:49:31 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:31 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b is fetched for user a78b4d7e96a046c4a1a26087bc67a7ba. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e5ec3-0279-4b16-aad1-2a5e38276acd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:32 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD Sep 06 22:49:32 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:32 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-392112872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a801ce4-1747-4d73-8e74-704c658d1ff5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:30Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Creating volume 4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:32 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:32 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1073741824 Sep 06 22:49:32 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:32 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1073741824" returned: 0 in 0.523s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:33 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 Sep 06 22:49:33 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:33 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Attempting download of 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 4a801ce4-1747-4d73-8e74-704c658d1ff5. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1de9a4-dbb5-418b-95c2-d875be697926]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:33 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe Sep 06 22:49:33 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:33 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:33 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe Sep 06 22:49:33 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:34 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe" returned: 1 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p6vz79pe' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cffa132-5a3c-4c20-ad84-9f7a71e17729]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:34 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD Sep 06 22:49:34 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:34 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Flow 'volume_create_manager' (14ebaebe-a089-46f6-8213-991546686dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3755ab-656e-4d0c-99ad-8dbe760b9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] 783de45c-ba65-43ef-be94-87e88c8ed95b was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:34 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3755ab-656e-4d0c-99ad-8dbe760b9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-625480937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7b9bb9-0281-4034-930c-f2e90091364b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a0803939534d1c9733380b4e530c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:34Z,use_quota=True,user_id='37c90f86bac44954bd8bb52c2445c57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:34 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bca981-d2b9-4725-adf2-76dea974528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bca981-d2b9-4725-adf2-76dea974528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bbe0bb-443e-454a-90d7-5f8f48a97320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bbe0bb-443e-454a-90d7-5f8f48a97320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7b9bb9-0281-4034-930c-f2e90091364b', 'volume_name': 'volume-ac7b9bb9-0281-4034-930c-f2e90091364b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498da379-689e-40f8-a2cb-5099d47358c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498da379-689e-40f8-a2cb-5099d47358c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6f8e97-0ca6-4376-b295-d8ecffa9c2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Volume ac7b9bb9-0281-4034-930c-f2e90091364b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7b9bb9-0281-4034-930c-f2e90091364b', 'volume_size': 1} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-625480937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7b9bb9-0281-4034-930c-f2e90091364b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a0803939534d1c9733380b4e530c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:34Z,use_quota=True,user_id='37c90f86bac44954bd8bb52c2445c57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Creating volume ac7b9bb9-0281-4034-930c-f2e90091364b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:34 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:34 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b 1073741824 Sep 06 22:49:34 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:35 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b 1073741824" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:35 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b Sep 06 22:49:35 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:35 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6f8e97-0ca6-4376-b295-d8ecffa9c2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7b9bb9-0281-4034-930c-f2e90091364b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703a9d79-8ee5-433c-bee0-55b28c4ad8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Volume volume-ac7b9bb9-0281-4034-930c-f2e90091364b (ac7b9bb9-0281-4034-930c-f2e90091364b): created successfully Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703a9d79-8ee5-433c-bee0-55b28c4ad8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Flow 'volume_create_manager' (14ebaebe-a089-46f6-8213-991546686dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e0b33c19-47cb-4e57-a5c1-c75fbdaf91cb tempest-AbsoluteLimitsTests-29203594 None] Created volume successfully. Sep 06 22:49:36 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5" returned: 0 in 1.679s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_0ocpi8redevstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:49:36 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Converted 112.00 MB image at 66.69 MB/s Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:36 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1G Sep 06 22:49:36 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:36 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 1G" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Downloaded image 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 4a801ce4-1747-4d73-8e74-704c658d1ff5 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b for user a78b4d7e96a046c4a1a26087bc67a7ba is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Marking volume 4a801ce4-1747-4d73-8e74-704c658d1ff5 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Copying metadata from image 783de45c-ba65-43ef-be94-87e88c8ed95b to 4a801ce4-1747-4d73-8e74-704c658d1ff5. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Creating volume glance metadata for volume 4a801ce4-1747-4d73-8e74-704c658d1ff5 backed by image 783de45c-ba65-43ef-be94-87e88c8ed95b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cc6d8c-d471-4251-b2f4-047ceac608ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a801ce4-1747-4d73-8e74-704c658d1ff5', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d66039-f784-4fbb-8683-f962c01c1247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Volume volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 (4a801ce4-1747-4d73-8e74-704c658d1ff5): created successfully Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d66039-f784-4fbb-8683-f962c01c1247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (48c4ef9a-245c-4408-89d0-46b92d4728f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6fd25b25-ebf2-4958-b907-8948a4c6362c tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Acquiring lock "cinder-ac7b9bb9-0281-4034-930c-f2e90091364b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "cinder-ac7b9bb9-0281-4034-930c-f2e90091364b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Acquiring lock "cinder-quobyte-ac7b9bb9-0281-4034-930c-f2e90091364b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "cinder-quobyte-ac7b9bb9-0281-4034-930c-f2e90091364b" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a03bc6-a0c6-4f03-947b-5720558cdfb7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:37 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b Sep 06 22:49:37 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Flow 'volume_create_manager' (57294b29-cd1f-4f23-8816-69d5afc26e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795787bf-8b3d-4f26-9f67-5a5500e84bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795787bf-8b3d-4f26-9f67-5a5500e84bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-58207693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acdd246-eb12-4dcd-818d-413be6b6b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4215c5924c42f6ab52635ff931ac71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:37Z,use_quota=True,user_id='0ddbfd94206144778f9718361ff32b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23665ec5-740f-495b-8dc7-a104a219e6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23665ec5-740f-495b-8dc7-a104a219e6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308ef4ef-d478-484d-b218-fadb69820029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308ef4ef-d478-484d-b218-fadb69820029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acdd246-eb12-4dcd-818d-413be6b6b46f', 'volume_name': 'volume-6acdd246-eb12-4dcd-818d-413be6b6b46f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8221fe85-85d4-42e5-84c0-430084da86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8221fe85-85d4-42e5-84c0-430084da86f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e87f0-568c-4d21-9f7f-9458dfc5d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Volume 6acdd246-eb12-4dcd-818d-413be6b6b46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acdd246-eb12-4dcd-818d-413be6b6b46f', 'volume_size': 1} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-58207693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acdd246-eb12-4dcd-818d-413be6b6b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4215c5924c42f6ab52635ff931ac71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:37Z,use_quota=True,user_id='0ddbfd94206144778f9718361ff32b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Creating volume 6acdd246-eb12-4dcd-818d-413be6b6b46f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:37 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f 1073741824 Sep 06 22:49:37 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:37 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:37 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b Sep 06 22:49:37 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:37 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f 1073741824" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:37 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ac7b9bb9-0281-4034-930c-f2e90091364b" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "cinder-quobyte-ac7b9bb9-0281-4034-930c-f2e90091364b" released by "delete_volume" :: held 0.679s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:37 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f Sep 06 22:49:37 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Created reservations ['68b1f8c8-9f62-4c83-bf3e-a7dcb74cac28', 'd09acbee-6fe1-45ac-a373-072add6aad0a', '2491ffcd-3d57-4bff-9512-39383e522f63', 'c766319c-016c-4d6d-a8b2-c121ae3d24ff'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:37 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:37 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:37 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e87f0-568c-4d21-9f7f-9458dfc5d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acdd246-eb12-4dcd-818d-413be6b6b46f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cae9dbe-e380-4f80-b63b-a86cdbb85bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Volume volume-6acdd246-eb12-4dcd-818d-413be6b6b46f (6acdd246-eb12-4dcd-818d-413be6b6b46f): created successfully Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cae9dbe-e380-4f80-b63b-a86cdbb85bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Flow 'volume_create_manager' (57294b29-cd1f-4f23-8816-69d5afc26e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91fdbb94-1ec9-40d8-9e8c-7b0268cd6902 tempest-AttachVolumeShelveTestJSON-836679226 None] Created volume successfully. Sep 06 22:49:38 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Deleted volume successfully. Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-163fd13d-15f3-4d86-967f-802423c163f0 tempest-AbsoluteLimitsTests-29203594 None] Lock "cinder-ac7b9bb9-0281-4034-930c-f2e90091364b-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (272434ce-29d5-4678-aca0-8210423100ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1570fb02-7094-4d74-ba71-6774a01e5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1570fb02-7094-4d74-ba71-6774a01e5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1948547396',display_name='tempest-VolumesGetTest-Volume-859866179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4f0670-1166-4d4d-b6b2-5af9c3260cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:38Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01f5e56-7af9-4c21-980b-d53a7dc5bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01f5e56-7af9-4c21-980b-d53a7dc5bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bc88b0-9e4e-4ecc-8a49-0a94b203584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bc88b0-9e4e-4ecc-8a49-0a94b203584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4f0670-1166-4d4d-b6b2-5af9c3260cb0', 'volume_name': 'volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac7d43-b956-4b55-ab91-d5c5a4236f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac7d43-b956-4b55-ab91-d5c5a4236f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29774229-20d4-4cdc-aaf6-b684fcaa38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Volume fe4f0670-1166-4d4d-b6b2-5af9c3260cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0', 'volume_size': 1} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1948547396',display_name='tempest-VolumesGetTest-Volume-859866179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4f0670-1166-4d4d-b6b2-5af9c3260cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0887cfd3e74bdaadc98b1524ac72ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:38Z,use_quota=True,user_id='a78b4d7e96a046c4a1a26087bc67a7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Creating volume fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:38 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:38 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 1073741824 Sep 06 22:49:38 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:39 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 1073741824" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:39 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 Sep 06 22:49:39 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:39 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29774229-20d4-4cdc-aaf6-b684fcaa38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb95686-cb7a-4994-a274-9f3b73415c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Volume volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 (fe4f0670-1166-4d4d-b6b2-5af9c3260cb0): created successfully Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb95686-cb7a-4994-a274-9f3b73415c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Flow 'volume_create_manager' (272434ce-29d5-4678-aca0-8210423100ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2b2f2fa9-f319-4a51-978d-4e99d8fbf7d7 tempest-VolumesGetTest-1539608732 None] Created volume successfully. Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "cinder-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aeee04-4cfc-4219-9d4d-a70e444f8645]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:40 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 Sep 06 22:49:41 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:41 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" returned: 0 in 0.566s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:41 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0 Sep 06 22:49:41 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:41 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0" released by "delete_volume" :: held 0.916s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Created reservations ['3c17efe0-5043-41ca-a391-272d68aadb8f', '5f66cbc1-9238-4532-9f2a-5e8686af391c', '590fde6e-e066-4d6a-97cf-39317809a26a', '44088cf3-b011-4cce-90ed-b713d170449f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:41 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:41 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-4a801ce4-1747-4d73-8e74-704c658d1ff5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "cinder-4a801ce4-1747-4d73-8e74-704c658d1ff5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Acquiring lock "cinder-quobyte-4a801ce4-1747-4d73-8e74-704c658d1ff5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4a801ce4-1747-4d73-8e74-704c658d1ff5" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:42 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6134bd4-4607-4841-9a42-4c5ac95b622b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a493e249-1d62-41d0-ae17-64bb301ec50c tempest-VolumesGetTest-1539608732 None] Lock "cinder-fe4f0670-1166-4d4d-b6b2-5af9c3260cb0-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:42 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 Sep 06 22:49:42 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:42 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5" returned: 0 in 0.511s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:42 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5 Sep 06 22:49:42 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:43 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4a801ce4-1747-4d73-8e74-704c658d1ff5" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "cinder-quobyte-4a801ce4-1747-4d73-8e74-704c658d1ff5" released by "delete_volume" :: held 0.937s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Created reservations ['48ce64cf-f68d-4518-bddb-05e6cd87c96a', '009aed2d-4b0d-406e-8fd4-8536064d19ad', '53051a22-0b16-4597-a4ea-d3766eaf2d0d', 'bef1cc46-a91a-41ec-bbd9-05febcfa3261'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:43 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:49:43 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:43 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:49:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Deleted volume successfully. Sep 06 22:49:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e68381ae-d517-4750-8a73-f86ca2d00609 tempest-VolumesGetTest-1539608732 None] Lock "cinder-4a801ce4-1747-4d73-8e74-704c658d1ff5-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Flow 'volume_create_manager' (d724ef19-5412-4368-8a74-f7dd5ea8ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534a64d0-8410-451c-8db7-b74acfc7a632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534a64d0-8410-451c-8db7-b74acfc7a632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-507769245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d63aebd-32df-4dde-bbbc-40c784bbf9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c46bff9d6a4cc59beb9d30aed2efbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:45Z,use_quota=True,user_id='eaedb2eb6376454d8a2b487e0b05eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346293ab-58df-4c19-b4fc-c42f7cd44660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346293ab-58df-4c19-b4fc-c42f7cd44660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f32361-c928-4e8c-891d-bb0a3a9dea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f32361-c928-4e8c-891d-bb0a3a9dea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d63aebd-32df-4dde-bbbc-40c784bbf9f1', 'volume_name': 'volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb159f4-1c5a-4fc2-bb22-9a92f3c695a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb159f4-1c5a-4fc2-bb22-9a92f3c695a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29072fdf-3cef-4438-8e97-314e575d3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1', 'volume_size': 1} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-507769245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d63aebd-32df-4dde-bbbc-40c784bbf9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c46bff9d6a4cc59beb9d30aed2efbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:45Z,use_quota=True,user_id='eaedb2eb6376454d8a2b487e0b05eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Creating volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:44 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:44 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 1073741824 Sep 06 22:49:44 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:45 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 1073741824" returned: 0 in 0.592s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:45 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 Sep 06 22:49:45 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:45 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29072fdf-3cef-4438-8e97-314e575d3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef0b461-6b81-4091-8dcc-a817521b5b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Volume volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 (6d63aebd-32df-4dde-bbbc-40c784bbf9f1): created successfully Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef0b461-6b81-4091-8dcc-a817521b5b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Flow 'volume_create_manager' (d724ef19-5412-4368-8a74-f7dd5ea8ab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c9c976db-187a-44a9-917b-ddfb5b74c910 tempest-VolumesSnapshotListTestJSON-333969868 None] Created volume successfully. Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (cf587436-c6b7-407c-a596-bf2e6961ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773d4d2-7cd0-4b5d-af1d-e74c1f506150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773d4d2-7cd0-4b5d-af1d-e74c1f506150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2144531649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c356224c-9038-4472-9024-21dac8ec3944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:46Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fcfc49-0626-4734-816c-df56eedafa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fcfc49-0626-4734-816c-df56eedafa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20fb87b-32fd-43b9-9fb9-52440eb8c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20fb87b-32fd-43b9-9fb9-52440eb8c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c356224c-9038-4472-9024-21dac8ec3944', 'volume_name': 'volume-c356224c-9038-4472-9024-21dac8ec3944', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ea5541-2b77-4ae1-ae15-5ba0865139b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ea5541-2b77-4ae1-ae15-5ba0865139b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaf7589-f692-4893-9c18-4f16a03b6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Volume c356224c-9038-4472-9024-21dac8ec3944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c356224c-9038-4472-9024-21dac8ec3944', 'volume_size': 1} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2144531649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c356224c-9038-4472-9024-21dac8ec3944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:46Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Creating volume c356224c-9038-4472-9024-21dac8ec3944 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:46 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 1073741824 Sep 06 22:49:46 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:47 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 1073741824" returned: 0 in 0.748s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:47 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 Sep 06 22:49:47 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:47 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.395s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaf7589-f692-4893-9c18-4f16a03b6c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c356224c-9038-4472-9024-21dac8ec3944', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebf28a8-0362-4312-8890-7403ef7e4d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Creating offline snapshot aaf50874-be3e-4d68-b157-a12d53ced3e3 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:49:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Volume volume-c356224c-9038-4472-9024-21dac8ec3944 (c356224c-9038-4472-9024-21dac8ec3944): created successfully Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebf28a8-0362-4312-8890-7403ef7e4d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (cf587436-c6b7-407c-a596-bf2e6961ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d53e92-3668-4bca-b226-36635b83244b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a2456254-5967-49ed-b70d-818a83524dda tempest-AttachVolumeNegativeTest-1990295743 None] Created volume successfully. Sep 06 22:49:47 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 Sep 06 22:49:47 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:48 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:48 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 1G Sep 06 22:49:48 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:48 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 1G" returned: 0 in 0.604s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:48 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:49:48 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:49 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 is being set with open permissions: ugo+rw Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:49 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:49:49 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4827c8a8-fe66-4e0f-b8ca-0ed8a4c84240 req-78056d57-377e-4e88-8ff8-0e516ce79b39 tempest-AttachVolumeShelveTestJSON-836679226 None] No connector for attachment af1e376c-4cc5-4c55-aace-f0fbc20f843e; skipping storage backend terminate_connection call. {{(pid=87517) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4827c8a8-fe66-4e0f-b8ca-0ed8a4c84240 req-78056d57-377e-4e88-8ff8-0e516ce79b39 tempest-AttachVolumeShelveTestJSON-836679226 None] Deleting attachment af1e376c-4cc5-4c55-aace-f0fbc20f843e. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:49:49 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-809b5df3-5c6b-4b5a-8389-546671c4d0a9 req-43bb0afc-27c2-4762-af63-930d315240d4 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:49 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info Sep 06 22:49:49 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:49 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info is being set with open permissions: ugo+rw Sep 06 22:49:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:49 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info Sep 06 22:49:49 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:50 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.info" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-809b5df3-5c6b-4b5a-8389-546671c4d0a9 req-43bb0afc-27c2-4762-af63-930d315240d4 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.690s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-809b5df3-5c6b-4b5a-8389-546671c4d0a9 req-43bb0afc-27c2-4762-af63-930d315240d4 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-15f99283-eae3-49bf-ba04-3901bba43274 tempest-VolumesSnapshotListTestJSON-333969868 None] Create snapshot completed successfully Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-809b5df3-5c6b-4b5a-8389-546671c4d0a9 req-43bb0afc-27c2-4762-af63-930d315240d4 tempest-AttachVolumeNegativeTest-1990295743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-c356224c-9038-4472-9024-21dac8ec3944', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d9bc683-bf6c-4793-bbd4-659a3694c425', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:49:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-809b5df3-5c6b-4b5a-8389-546671c4d0a9 req-43bb0afc-27c2-4762-af63-930d315240d4 tempest-AttachVolumeNegativeTest-1990295743 None] attachment_update completed successfully. Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Creating offline snapshot 0182a958-498a-4ebe-8866-5552ced2c955 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea8c95-3ba0-4f57-970c-26949d792b2f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:50 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:49:50 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:51 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.587s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:51 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 1G Sep 06 22:49:51 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:51 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 1G" returned: 0 in 0.572s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:51 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:49:51 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:52 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:52 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 is being set with open permissions: ugo+rw Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:52 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:49:52 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:52 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f426267f-f13b-4ff2-af8a-edd49d816836 tempest-VolumesSnapshotListTestJSON-333969868 None] Create snapshot completed successfully Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Creating offline snapshot aaa4c1b6-6faf-45f6-a9ab-c449076eed73 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073b8d3-29d4-48eb-96aa-bdf492e1b764]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:53 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:49:53 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:53 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.572s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:53 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 1G Sep 06 22:49:53 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-1f89050f-ab19-42dd-90fc-d89660c76271 req-c67d8eb6-cf13-411b-8eb5-3b97f279115f tempest-AttachVolumeNegativeTest-1990295743 None] Terminate volume connection completed successfully. Sep 06 22:49:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-1f89050f-ab19-42dd-90fc-d89660c76271 req-c67d8eb6-cf13-411b-8eb5-3b97f279115f tempest-AttachVolumeNegativeTest-1990295743 None] Deleting attachment 2d9bc683-bf6c-4793-bbd4-659a3694c425. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (bb130968-f80c-4094-8809-e58d2fa5ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2123f2-65d8-47b8-be75-3f5eef0fdcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2123f2-65d8-47b8-be75-3f5eef0fdcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1087013373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a7ed0d-0fff-40a7-980e-fdcd060143f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:54Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bb48d7-3d8c-447d-a2d7-1cf3cb320e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bb48d7-3d8c-447d-a2d7-1cf3cb320e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b7b3e-483a-4d6e-94fc-bab64fa5a309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b7b3e-483a-4d6e-94fc-bab64fa5a309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a7ed0d-0fff-40a7-980e-fdcd060143f2', 'volume_name': 'volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347949db-76de-4633-901f-6e7e3c296655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347949db-76de-4633-901f-6e7e3c296655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc28db02-21a2-498c-b860-d96df7aa7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Volume 32a7ed0d-0fff-40a7-980e-fdcd060143f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2', 'volume_size': 1} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:54 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 1G" returned: 0 in 0.946s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:54 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 Sep 06 22:49:54 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:54 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 is being set with open permissions: ugo+rw Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:55 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 Sep 06 22:49:55 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:55 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1087013373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a7ed0d-0fff-40a7-980e-fdcd060143f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:54Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Creating volume 32a7ed0d-0fff-40a7-980e-fdcd060143f2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:55 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:55 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 1073741824 Sep 06 22:49:55 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7867d570-c4e3-44f8-a50d-d2bdf8d7a267 tempest-VolumesSnapshotListTestJSON-333969868 None] Create snapshot completed successfully Sep 06 22:49:56 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 1073741824" returned: 0 in 0.790s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:56 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 Sep 06 22:49:56 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:56 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2" returned: 0 in 0.486s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc28db02-21a2-498c-b860-d96df7aa7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f3b198-84ff-488c-aa33-141f5c6dd5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Volume volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 (32a7ed0d-0fff-40a7-980e-fdcd060143f2): created successfully Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f3b198-84ff-488c-aa33-141f5c6dd5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (bb130968-f80c-4094-8809-e58d2fa5ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2e2e85cb-0257-4980-ae93-efd84c74b81d tempest-VolumesListTestJSON-1374191485 None] Created volume successfully. Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-aaa4c1b6-6faf-45f6-a9ab-c449076eed73-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-aaa4c1b6-6faf-45f6-a9ab-c449076eed73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-aaa4c1b6-6faf-45f6-a9ab-c449076eed73" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-aaa4c1b6-6faf-45f6-a9ab-c449076eed73" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Deleting offline snapshot aaa4c1b6-6faf-45f6-a9ab-c449076eed73 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] snapshot_file for this snap is: volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[02313ffd-6be7-4bef-90f9-8fbd8e3f6863]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:57 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 Sep 06 22:49:57 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:58 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73" returned: 0 in 0.527s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f35703-61e3-4990-8f60-afa09f8ff5d6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (61e5dbae-8449-4ce6-a63d-b0554134795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357ad2df-94f8-4006-84d9-48cd08e924e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357ad2df-94f8-4006-84d9-48cd08e924e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-211518922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137873b4-b497-42a7-85d1-230fc527c97c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:58Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3f60e2-9850-4a64-b4ac-e4b2414fc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3f60e2-9850-4a64-b4ac-e4b2414fc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:58 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:49:58 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4662485e-920b-423c-9e06-e42d88b2ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4662485e-920b-423c-9e06-e42d88b2ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137873b4-b497-42a7-85d1-230fc527c97c', 'volume_name': 'volume-137873b4-b497-42a7-85d1-230fc527c97c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d431ee-f162-490d-b53b-c8a491dfd7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d431ee-f162-490d-b53b-c8a491dfd7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d739a8-9e00-4096-9aa7-8a85e4777b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Volume 137873b4-b497-42a7-85d1-230fc527c97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137873b4-b497-42a7-85d1-230fc527c97c', 'volume_size': 1} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-211518922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137873b4-b497-42a7-85d1-230fc527c97c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:49:58Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Creating volume 137873b4-b497-42a7-85d1-230fc527c97c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:49:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:58 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c 1073741824 Sep 06 22:49:58 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:58 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:58 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 Sep 06 22:49:58 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:59 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c 1073741824" returned: 0 in 0.662s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:59 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c Sep 06 22:49:59 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:59 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73" returned: 0 in 0.599s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:49:59 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73 Sep 06 22:49:59 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:49:59 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d739a8-9e00-4096-9aa7-8a85e4777b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137873b4-b497-42a7-85d1-230fc527c97c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6943a-b901-4eef-8b7e-1d2385136d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:49:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Volume volume-137873b4-b497-42a7-85d1-230fc527c97c (137873b4-b497-42a7-85d1-230fc527c97c): created successfully Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6943a-b901-4eef-8b7e-1d2385136d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (61e5dbae-8449-4ce6-a63d-b0554134795f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:49:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e740a833-d5ee-4d10-8d41-01ad52278a96 tempest-VolumesListTestJSON-1374191485 None] Created volume successfully. Sep 06 22:49:59 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaa4c1b6-6faf-45f6-a9ab-c449076eed73" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-aaa4c1b6-6faf-45f6-a9ab-c449076eed73" released by "_delete_snapshot" :: held 2.121s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" released by "delete_snapshot" :: held 2.147s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Created reservations ['fd3d5eca-fa80-4fa7-9368-23d02e2b9f3a', 'cbfab8dc-cdf4-4797-b0e4-116390572151', '0b7d41d9-e19a-44cd-82db-2e831865b365', '7741e87c-0446-4d06-ad75-76fe8373bf69'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:49:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Delete snapshot completed successfully. Sep 06 22:49:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d2629f8-8af5-4ac9-a7d3-66b4f793a197 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-aaa4c1b6-6faf-45f6-a9ab-c449076eed73-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-0182a958-498a-4ebe-8866-5552ced2c955-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-0182a958-498a-4ebe-8866-5552ced2c955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-0182a958-498a-4ebe-8866-5552ced2c955" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-0182a958-498a-4ebe-8866-5552ced2c955" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Deleting offline snapshot 0182a958-498a-4ebe-8866-5552ced2c955 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] snapshot_file for this snap is: volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a084ef-542f-4df6-9395-d0aa5610c88b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:01 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:50:01 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (68d6c199-98b1-4ff7-afaa-d5bfa2563040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ff4522-08b8-4cf8-840a-aa4ae802c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ff4522-08b8-4cf8-840a-aa4ae802c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-936550337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:01Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c1a39c-cd2b-416e-ab3b-4fc582a09536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c1a39c-cd2b-416e-ab3b-4fc582a09536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26571d93-d8c1-4658-8327-a03ab02213b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26571d93-d8c1-4658-8327-a03ab02213b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6', 'volume_name': 'volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fe4c2f-e9af-4660-980b-a0533e81a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fe4c2f-e9af-4660-980b-a0533e81a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e41568b-24fb-4108-ac50-28cd743261e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Volume ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6', 'volume_size': 1} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-936550337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='693ddb835cc143a1911f27bad7ea10e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:01Z,use_quota=True,user_id='124232b6ae79485f8753bcf0deedc5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Creating volume ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:01 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:01 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 1073741824 Sep 06 22:50:01 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:01 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.654s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534ade2-854f-4d2e-bc30-48d03ce5a405]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:02 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:50:02 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:02 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 1073741824" returned: 0 in 0.865s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:02 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 Sep 06 22:50:02 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:02 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.849s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:02 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:50:02 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:03 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" returned: 0 in 0.512s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e41568b-24fb-4108-ac50-28cd743261e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117bd14b-02ff-4f07-88cb-67505f556f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Volume volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 (ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6): created successfully Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117bd14b-02ff-4f07-88cb-67505f556f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Flow 'volume_create_manager' (68d6c199-98b1-4ff7-afaa-d5bfa2563040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2b1df9ec-3513-48ad-b2b9-f78a28dbf7e7 tempest-VolumesListTestJSON-1374191485 None] Created volume successfully. Sep 06 22:50:03 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.910s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:03 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955 Sep 06 22:50:03 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:03 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.0182a958-498a-4ebe-8866-5552ced2c955" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-0182a958-498a-4ebe-8866-5552ced2c955" released by "_delete_snapshot" :: held 2.964s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" released by "delete_snapshot" :: held 3.022s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:04 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Created reservations ['c76a3736-a55c-4005-879d-370cc7c8193a', 'f8aebae7-57b5-438a-924b-13385a1c41e6', '8ab4847b-493b-4125-9475-d332cb9aea24', 'ca3b18a2-ff34-4e49-bfe3-eb973f2cc530'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Delete snapshot completed successfully. Sep 06 22:50:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-822a51de-77df-42d6-bfc6-ffa0358d95f3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-0182a958-498a-4ebe-8866-5552ced2c955-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-aaf50874-be3e-4d68-b157-a12d53ced3e3-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-aaf50874-be3e-4d68-b157-a12d53ced3e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-aaf50874-be3e-4d68-b157-a12d53ced3e3" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-aaf50874-be3e-4d68-b157-a12d53ced3e3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Deleting offline snapshot aaf50874-be3e-4d68-b157-a12d53ced3e3 of volume 6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] snapshot_file for this snap is: volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c0d89-a82b-4f36-b5e9-d72760364f1f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:05 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:50:05 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:05 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:05 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:05 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[424500f1-5ef0-4e0b-a19a-4727acace242]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:06 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 Sep 06 22:50:06 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:06 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.471s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:06 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" returned: 0 in 0.625s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:06 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:50:06 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-quobyte-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd902c-e01c-4fd7-9477-c2cc11ec6cc7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:06 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 Sep 06 22:50:06 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:07 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.616s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:07 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3 Sep 06 22:50:07 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:07 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" returned: 0 in 0.548s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:07 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6 Sep 06 22:50:07 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:07 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1.aaf50874-be3e-4d68-b157-a12d53ced3e3" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:07 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-aaf50874-be3e-4d68-b157-a12d53ced3e3" released by "_delete_snapshot" :: held 2.379s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" released by "delete_snapshot" :: held 2.421s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6" released by "delete_volume" :: held 1.116s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Created reservations ['b7a39bdf-0e49-43df-9083-53ce18b260b0', 'd6516aad-d118-4682-960f-da7f7e76ca1a', 'ea9cc77e-b156-49f6-9619-69f056e833dd', 'd4dfc731-d33b-4aee-bad1-213f31a500ae'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Created reservations ['789a5c1c-e868-4ac1-bbb1-55200fa88d33', 'eeeb2a06-660f-47b1-bc5a-6b16a8bb75f6', 'ee397c05-39aa-4a16-b2d8-3dab25f68090', '959ea3d9-dad1-4d57-81ff-31ed6cb6744e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Delete snapshot completed successfully. Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca5284b3-7617-4a38-a04c-67e17444d20d tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-aaf50874-be3e-4d68-b157-a12d53ced3e3-delete_snapshot" released by "delete_snapshot" :: held 2.746s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:08 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:08 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:08 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.332s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Deleted volume successfully. Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-80407553-32d5-40b6-b6fc-a081590409bb tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-ee9db12e-bd05-4ad3-a4f2-8453aa2e24c6-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-6d63aebd-32df-4dde-bbbc-40c784bbf9f1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-6d63aebd-32df-4dde-bbbc-40c784bbf9f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e87812-c550-49ee-b5b8-85e9cefcfdba]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:08 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 Sep 06 22:50:08 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-137873b4-b497-42a7-85d1-230fc527c97c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-137873b4-b497-42a7-85d1-230fc527c97c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-quobyte-137873b4-b497-42a7-85d1-230fc527c97c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-137873b4-b497-42a7-85d1-230fc527c97c" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43889c-bf00-4aa2-92ea-1cc42134b073]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:09 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" returned: 0 in 0.607s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:09 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1 Sep 06 22:50:09 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:09 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c Sep 06 22:50:09 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:09 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-quobyte-6d63aebd-32df-4dde-bbbc-40c784bbf9f1" released by "delete_volume" :: held 1.048s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Created reservations ['e5c3cac6-35c6-4470-8944-8f15ef82ebb2', 'fac26c07-6eaa-481d-84a3-f76988b65c57', '1cf45f79-fba6-435c-801a-11424b6fb1bd', '2ff44d5b-a978-4201-bfcf-19a0fb1e4b45'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:09 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c" returned: 0 in 0.552s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:09 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c Sep 06 22:50:09 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:10 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:10 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:10 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-137873b4-b497-42a7-85d1-230fc527c97c" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-137873b4-b497-42a7-85d1-230fc527c97c" released by "delete_volume" :: held 0.932s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Created reservations ['56cf3ae5-14c9-496d-98e4-2530321ab245', '34abab23-93f0-4013-aa2c-f05cadbe9e27', '26d50de6-5ffd-4073-ab49-b64e869850f2', 'a3f8cb1a-2cdb-4953-94f8-662bfab4cbec'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:10 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Deleted volume successfully. Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62515ea2-a016-4900-a28d-e6cb3624d0e3 tempest-VolumesSnapshotListTestJSON-333969868 None] Lock "cinder-6d63aebd-32df-4dde-bbbc-40c784bbf9f1-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:10 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:10 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:11 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.764s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Deleted volume successfully. Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5113120a-fb42-45cb-a393-c6de4239d881 tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-137873b4-b497-42a7-85d1-230fc527c97c-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-32a7ed0d-0fff-40a7-980e-fdcd060143f2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-32a7ed0d-0fff-40a7-980e-fdcd060143f2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "cinder-quobyte-32a7ed0d-0fff-40a7-980e-fdcd060143f2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-32a7ed0d-0fff-40a7-980e-fdcd060143f2" acquired by "delete_volume" :: waited 0.080s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f7234-1023-4227-810c-e9704efe099f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:12 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 Sep 06 22:50:12 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:12 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2" returned: 0 in 0.792s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:12 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2 Sep 06 22:50:12 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:13 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-32a7ed0d-0fff-40a7-980e-fdcd060143f2" returned: 0 in 0.565s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-quobyte-32a7ed0d-0fff-40a7-980e-fdcd060143f2" released by "delete_volume" :: held 1.522s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Created reservations ['1dc6c0df-9977-4d47-8492-7e22c47fdae9', '7224d94e-aeb6-49af-be79-a59a7fa6e6fd', 'bcac0558-068e-4ecd-8f88-7a3ab7d3f498', '803d81ce-43e3-488f-bd88-608dfd5773a2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:13 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:13 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:14 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.474s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:14 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Deleted volume successfully. Sep 06 22:50:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-31195c13-c874-453d-9a73-21fd9d4016fc tempest-VolumesListTestJSON-1374191485 None] Lock "cinder-32a7ed0d-0fff-40a7-980e-fdcd060143f2-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=157,cinder:SELECT=129,cinder:INSERT=38,cinder:DELETE=14 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=143,cinder:SELECT=122,cinder:INSERT=57,cinder:DELETE=12 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (4884a4ce-495e-4d02-b4a7-86489bd3ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83f5e0c-6c03-4ee1-83b3-9b8b93598aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83f5e0c-6c03-4ee1-83b3-9b8b93598aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817573169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f343b947-59bc-414a-a481-769e01988c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:19Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7499b28-8850-4582-a4d4-71de91f3783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7499b28-8850-4582-a4d4-71de91f3783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b13323-eb8d-49f3-8934-bc0b661071a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b13323-eb8d-49f3-8934-bc0b661071a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f343b947-59bc-414a-a481-769e01988c0f', 'volume_name': 'volume-f343b947-59bc-414a-a481-769e01988c0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e0bb7e-b4cc-4f95-8783-9cf5a719819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e0bb7e-b4cc-4f95-8783-9cf5a719819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2808a7eb-c2fb-4562-8354-7bf821f45cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume f343b947-59bc-414a-a481-769e01988c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f343b947-59bc-414a-a481-769e01988c0f', 'volume_size': 1} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817573169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f343b947-59bc-414a-a481-769e01988c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:19Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume f343b947-59bc-414a-a481-769e01988c0f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:18 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f 1073741824 Sep 06 22:50:18 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:19 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f 1073741824" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:19 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f Sep 06 22:50:19 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:19 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2808a7eb-c2fb-4562-8354-7bf821f45cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f343b947-59bc-414a-a481-769e01988c0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9afaf7-3da4-4452-975d-4b52036de63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-f343b947-59bc-414a-a481-769e01988c0f (f343b947-59bc-414a-a481-769e01988c0f): created successfully Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9afaf7-3da4-4452-975d-4b52036de63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (4884a4ce-495e-4d02-b4a7-86489bd3ced3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f53d77a2-a4f7-47ef-89a8-b58d54df3c2e tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (bde547fb-4d5d-497d-ba50-7c548591d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ef71a-7b9b-4c66-af8c-a3bd65b35013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ef71a-7b9b-4c66-af8c-a3bd65b35013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511296033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade01ff3-e30d-4758-b61d-a39072214e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:21Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b76cab4-e0dd-4803-a288-5a45e31bbcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b76cab4-e0dd-4803-a288-5a45e31bbcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46743c84-4359-45fa-bed8-5cd202b05175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46743c84-4359-45fa-bed8-5cd202b05175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade01ff3-e30d-4758-b61d-a39072214e61', 'volume_name': 'volume-ade01ff3-e30d-4758-b61d-a39072214e61', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb37bb9-aa00-45bc-84da-bc5105c43d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb37bb9-aa00-45bc-84da-bc5105c43d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf3d519-7176-4625-b423-a2a91e1e126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume ade01ff3-e30d-4758-b61d-a39072214e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade01ff3-e30d-4758-b61d-a39072214e61', 'volume_size': 1} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511296033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade01ff3-e30d-4758-b61d-a39072214e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:21Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume ade01ff3-e30d-4758-b61d-a39072214e61 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:21 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 1073741824 Sep 06 22:50:21 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (63ec2ecd-8721-408b-b14d-59ada10a888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe95137-892d-4df5-af92-db0397ddfc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe95137-892d-4df5-af92-db0397ddfc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798730540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b131f0a-cd7a-41f6-b820-e74f1ba9108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:22Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a71aabb-28fb-407a-b5b2-513c8d5f1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a71aabb-28fb-407a-b5b2-513c8d5f1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35b0397-dfb0-4933-87d7-45c6443f14d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35b0397-dfb0-4933-87d7-45c6443f14d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b131f0a-cd7a-41f6-b820-e74f1ba9108b', 'volume_name': 'volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4bfe6f-339c-40f3-9f35-af359ff71206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4bfe6f-339c-40f3-9f35-af359ff71206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff170179-736b-41fa-a200-cee127285ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume 7b131f0a-cd7a-41f6-b820-e74f1ba9108b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b', 'volume_size': 1} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:22 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 1073741824" returned: 0 in 0.688s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:22 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 Sep 06 22:50:22 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (01872e69-2766-4f85-9582-cbe14c46f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd3a527-22b6-46fe-a4cd-e318ff6f6405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd3a527-22b6-46fe-a4cd-e318ff6f6405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470399728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11297d3a-fad5-487e-8d66-4295c5e40c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:23Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7227d0c-7a1e-429c-8f90-4bcdfa3ffaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7227d0c-7a1e-429c-8f90-4bcdfa3ffaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e386c0-ae02-4263-9479-f938f6f347af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e386c0-ae02-4263-9479-f938f6f347af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11297d3a-fad5-487e-8d66-4295c5e40c69', 'volume_name': 'volume-11297d3a-fad5-487e-8d66-4295c5e40c69', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b33def-ce04-4874-ab1e-af49617e8b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b33def-ce04-4874-ab1e-af49617e8b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f604265-4ee5-4c9f-b98d-0560f2a13d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume 11297d3a-fad5-487e-8d66-4295c5e40c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11297d3a-fad5-487e-8d66-4295c5e40c69', 'volume_size': 1} Sep 06 22:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61" returned: 0 in 0.726s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798730540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b131f0a-cd7a-41f6-b820-e74f1ba9108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:22Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume 7b131f0a-cd7a-41f6-b820-e74f1ba9108b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf3d519-7176-4625-b423-a2a91e1e126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade01ff3-e30d-4758-b61d-a39072214e61', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a70d0b-d181-46f7-a42f-0cb0d666cc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:23 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b 1073741824 Sep 06 22:50:23 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-ade01ff3-e30d-4758-b61d-a39072214e61 (ade01ff3-e30d-4758-b61d-a39072214e61): created successfully Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a70d0b-d181-46f7-a42f-0cb0d666cc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (bde547fb-4d5d-497d-ba50-7c548591d79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-357e1b2f-adb5-4ba3-900a-fe904d4f1e73 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:24 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b 1073741824" returned: 0 in 1.159s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:24 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b Sep 06 22:50:24 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (433324f4-8556-41e4-8768-c5f22cc1d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b86d-7095-4cee-80b2-e860da3e7701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b86d-7095-4cee-80b2-e860da3e7701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339894221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd7b81-8884-426e-82c5-31a7620c56e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:24Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cee18d-1918-4305-b7d3-ad58ab491551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cee18d-1918-4305-b7d3-ad58ab491551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b687fd6d-9567-47a3-9117-222d2721a577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b687fd6d-9567-47a3-9117-222d2721a577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfd7b81-8884-426e-82c5-31a7620c56e0', 'volume_name': 'volume-6cfd7b81-8884-426e-82c5-31a7620c56e0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba58ea9-ea83-43e2-a911-cdc3b408ae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba58ea9-ea83-43e2-a911-cdc3b408ae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fb0ae5-608e-4ccf-9c86-0e154cb85828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume 6cfd7b81-8884-426e-82c5-31a7620c56e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfd7b81-8884-426e-82c5-31a7620c56e0', 'volume_size': 1} Sep 06 22:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:25 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" returned: 0 in 0.766s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470399728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11297d3a-fad5-487e-8d66-4295c5e40c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:23Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume 11297d3a-fad5-487e-8d66-4295c5e40c69 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff170179-736b-41fa-a200-cee127285ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 1073741824 Sep 06 22:50:25 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd7a40-af71-43f9-9ad8-165b4f03e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b (7b131f0a-cd7a-41f6-b820-e74f1ba9108b): created successfully Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd7a40-af71-43f9-9ad8-165b4f03e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (63ec2ecd-8721-408b-b14d-59ada10a888a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c09d4258-a3ea-459a-8d73-4e3dce0b3817 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (9168a9b4-5c36-475f-8268-6c1c2a6bd4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b280008f-da87-48ec-8632-3cc8b29c7573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b280008f-da87-48ec-8632-3cc8b29c7573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059347464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:25Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24fa719-6437-40c6-91c3-46c62d125984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24fa719-6437-40c6-91c3-46c62d125984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5779b05-3edc-4905-90ef-bd6617ae93f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5779b05-3edc-4905-90ef-bd6617ae93f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8', 'volume_name': 'volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f7d2c-04ca-4ed5-8249-0087972426c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f7d2c-04ca-4ed5-8249-0087972426c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81769e6-a10c-41a1-a3fc-00735436c2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume 1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8', 'volume_size': 1} Sep 06 22:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:26 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 1073741824" returned: 0 in 0.981s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:26 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 Sep 06 22:50:26 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:26 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339894221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd7b81-8884-426e-82c5-31a7620c56e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:24Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume 6cfd7b81-8884-426e-82c5-31a7620c56e0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f604265-4ee5-4c9f-b98d-0560f2a13d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11297d3a-fad5-487e-8d66-4295c5e40c69', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:26 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 1073741824 Sep 06 22:50:26 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d8807d-5511-42c4-b463-2173a56923b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-11297d3a-fad5-487e-8d66-4295c5e40c69 (11297d3a-fad5-487e-8d66-4295c5e40c69): created successfully Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d8807d-5511-42c4-b463-2173a56923b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (01872e69-2766-4f85-9582-cbe14c46f271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-844e3bce-8446-4f09-8453-c220bad78d34 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:27 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 1073741824" returned: 0 in 0.671s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:27 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 Sep 06 22:50:27 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:27 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0" returned: 0 in 0.494s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059347464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751106c806f4d68a28295ca6ecedcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:25Z,use_quota=True,user_id='226ce54f6fa44f2bb9719cdaf558bc0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Creating volume 1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:28 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 1073741824 Sep 06 22:50:28 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fb0ae5-608e-4ccf-9c86-0e154cb85828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfd7b81-8884-426e-82c5-31a7620c56e0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fee3bc-d966-4b40-9380-7ce7ee9b90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 (6cfd7b81-8884-426e-82c5-31a7620c56e0): created successfully Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8fee3bc-d966-4b40-9380-7ce7ee9b90a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (433324f4-8556-41e4-8768-c5f22cc1d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-03245301-0825-4d50-a930-681b2cffa8d9 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:28 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 1073741824" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:28 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 Sep 06 22:50:28 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:28 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81769e6-a10c-41a1-a3fc-00735436c2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c1094a-ea32-4e14-9b48-60c7ee9f2cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Volume volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 (1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8): created successfully Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c1094a-ea32-4e14-9b48-60c7ee9f2cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Flow 'volume_create_manager' (9168a9b4-5c36-475f-8268-6c1c2a6bd4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b452402b-7f3e-45ab-8654-d24369c96a43 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created volume successfully. Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[61906f50-8bdb-4880-afd1-73ae2b47d060]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:30 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 Sep 06 22:50:30 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:30 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" returned: 0 in 0.483s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:30 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8 Sep 06 22:50:30 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:31 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8" released by "delete_volume" :: held 0.826s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['81669f7e-9031-4ac3-8ddf-6738981b7a21', '04bdbce6-6f5b-46de-a884-2720fa407c44', 'e65c9542-903a-4480-ada2-00407eb3e255', '3de6fb76-0d8a-4f63-b2d3-566e0caa6d3e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:31 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:31 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-6cfd7b81-8884-426e-82c5-31a7620c56e0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-6cfd7b81-8884-426e-82c5-31a7620c56e0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-6cfd7b81-8884-426e-82c5-31a7620c56e0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-6cfd7b81-8884-426e-82c5-31a7620c56e0" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[691dc181-f774-4c84-99ef-bb60a08b13ed]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:31 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e16b6f69-16d0-4b4a-a822-64df5bceee64 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-1d5344d7-1f9a-4e7e-ad6e-9e1bfd5505b8-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:31 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 Sep 06 22:50:31 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:31 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:32 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0 Sep 06 22:50:32 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:32 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6cfd7b81-8884-426e-82c5-31a7620c56e0" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-6cfd7b81-8884-426e-82c5-31a7620c56e0" released by "delete_volume" :: held 0.778s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Acquiring lock "cinder-6acdd246-eb12-4dcd-818d-413be6b6b46f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "cinder-6acdd246-eb12-4dcd-818d-413be6b6b46f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['684ed2c2-4aa2-428b-92d1-a6ee0e275b42', '558cf546-439d-488f-b075-71ff22b2fe0e', 'fac22d62-1232-4615-a5b1-8a0b4009cbc0', 'a6052e3d-3ba5-43e6-afb4-6ff2ff512612'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Acquiring lock "cinder-quobyte-6acdd246-eb12-4dcd-818d-413be6b6b46f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "cinder-quobyte-6acdd246-eb12-4dcd-818d-413be6b6b46f" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[349cb4ad-fc56-4ef3-be20-393f4be56d67]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:32 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:32 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-11297d3a-fad5-487e-8d66-4295c5e40c69-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-11297d3a-fad5-487e-8d66-4295c5e40c69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:32 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f Sep 06 22:50:32 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-11297d3a-fad5-487e-8d66-4295c5e40c69" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-11297d3a-fad5-487e-8d66-4295c5e40c69" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0923b32b-9d43-480a-ab6d-f3c653a3cc27]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:32 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 Sep 06 22:50:32 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:33 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.539s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:33 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f" returned: 0 in 0.541s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:33 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ef10c5c-394b-4331-aeb8-1fc6392286bc tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-6cfd7b81-8884-426e-82c5-31a7620c56e0-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:33 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:33 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:33 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69 Sep 06 22:50:33 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:33 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6acdd246-eb12-4dcd-818d-413be6b6b46f" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "cinder-quobyte-6acdd246-eb12-4dcd-818d-413be6b6b46f" released by "delete_volume" :: held 1.028s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Created reservations ['fd6aeabb-0ec4-4465-8ec5-96d5e61f072b', '88126e32-3b11-4c2f-acae-e9d4f7f68307', 'b3a3512b-9914-476e-902d-06ae353c871e', '52c4fb09-cfa6-4668-b5a6-277b0e446694'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:33 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-11297d3a-fad5-487e-8d66-4295c5e40c69" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-11297d3a-fad5-487e-8d66-4295c5e40c69" released by "delete_volume" :: held 0.906s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:33 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:33 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['b7680ab8-ef20-40e5-9700-ee6f5c6d9503', 'ceea27bb-9c53-4832-b1a4-fe5ee88a70b0', '42c6445b-f0d4-4773-96cb-89bb82121fbe', '283b9bd0-0e66-4ded-b329-c64020ce6169'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:33 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:33 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-7b131f0a-cd7a-41f6-b820-e74f1ba9108b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-7b131f0a-cd7a-41f6-b820-e74f1ba9108b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:34 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Deleted volume successfully. Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-738ba9fd-64dd-4151-a621-b13878eafb34 tempest-AttachVolumeShelveTestJSON-836679226 None] Lock "cinder-6acdd246-eb12-4dcd-818d-413be6b6b46f-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c35ea2-5d06-489b-8804-32e702dadac7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:34 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3cd5a398-a474-49b3-adcd-b8ec0cf5dc38 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-11297d3a-fad5-487e-8d66-4295c5e40c69-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:34 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b Sep 06 22:50:34 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:34 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:34 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b Sep 06 22:50:34 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:34 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-7b131f0a-cd7a-41f6-b820-e74f1ba9108b" released by "delete_volume" :: held 0.801s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['17b1636f-a4e0-4b06-9a63-57e97d79e09c', '946e3216-7d92-4705-bf68-c8223cb70ea8', '39effcc3-c8fc-4692-9167-68ccebdf9e7b', '21ae7d8d-7522-4a5c-9f57-93e9302b9a3d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:35 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:35 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-ade01ff3-e30d-4758-b61d-a39072214e61-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-ade01ff3-e30d-4758-b61d-a39072214e61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-ade01ff3-e30d-4758-b61d-a39072214e61" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-ade01ff3-e30d-4758-b61d-a39072214e61" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[78920b26-ddd8-43b9-aaf1-5670372bb3b1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:35 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e3af289-bb6a-4f62-92c5-a19fd2c4a4ac tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-7b131f0a-cd7a-41f6-b820-e74f1ba9108b-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:35 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 Sep 06 22:50:35 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:35 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61" returned: 0 in 0.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:36 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61 Sep 06 22:50:36 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:36 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ade01ff3-e30d-4758-b61d-a39072214e61" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-ade01ff3-e30d-4758-b61d-a39072214e61" released by "delete_volume" :: held 0.761s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['5042aaa2-5956-4c88-8315-a323b1c8df5b', 'b6116247-a2bb-453f-96fa-88a1e8451008', '3ef3a3ea-ef9a-4dfa-9da0-7d1627dec779', 'b3f2adbc-f129-42eb-8d29-efc0140ba9d6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:36 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:36 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-f343b947-59bc-414a-a481-769e01988c0f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-f343b947-59bc-414a-a481-769e01988c0f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "cinder-quobyte-f343b947-59bc-414a-a481-769e01988c0f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:36 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-f343b947-59bc-414a-a481-769e01988c0f" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d793a98-cbf7-422c-8a4c-5c189fbb428b tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-ade01ff3-e30d-4758-b61d-a39072214e61-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7157fa6-e47c-49ca-b733-c2d79123d410]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:36 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f Sep 06 22:50:36 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:37 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f" returned: 0 in 0.499s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:37 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f Sep 06 22:50:37 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:37 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f343b947-59bc-414a-a481-769e01988c0f" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-quobyte-f343b947-59bc-414a-a481-769e01988c0f" released by "delete_volume" :: held 0.899s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Created reservations ['2972e44f-0b39-479f-a8d7-bfd0d76204a8', '0960cfdb-e5ff-4764-945e-f1d8ec7b2715', '6422f42c-7c54-4e59-93b7-d8e238bf624c', '1f092294-a765-49bd-838d-80c27fe43d14'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:37 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:37 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (a400b03a-b7ac-44fc-bb2b-a790aa696fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac029b1-e8de-4eee-b6d0-d3fd5025b68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac029b1-e8de-4eee-b6d0-d3fd5025b68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-625978514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef3230-e143-41d2-9bc9-41bd58d8e73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:38Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7096fb-f64e-44b4-8ab6-bd79faf0521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7096fb-f64e-44b4-8ab6-bd79faf0521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467e57b3-d19d-48c5-b588-8f8da152ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467e57b3-d19d-48c5-b588-8f8da152ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ef3230-e143-41d2-9bc9-41bd58d8e73b', 'volume_name': 'volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c36a83-9470-44e4-be0e-aced9f84ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c36a83-9470-44e4-be0e-aced9f84ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63635a13-aafd-4d8d-a850-710cbe056764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Volume 31ef3230-e143-41d2-9bc9-41bd58d8e73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b', 'volume_size': 1} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-625978514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef3230-e143-41d2-9bc9-41bd58d8e73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69646f934cc24783b8900ad4ea70f12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:38Z,use_quota=True,user_id='5f6930524e3344608f6129517d4ed90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Creating volume 31ef3230-e143-41d2-9bc9-41bd58d8e73b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:38 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:38 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b 1073741824 Sep 06 22:50:38 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:38 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Deleted volume successfully. Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f752106-3b08-4523-bc53-8ce39f586ea0 tempest-CreateVolumesFromSourceVolumeTest-256519551 None] Lock "cinder-f343b947-59bc-414a-a481-769e01988c0f-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:38 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b 1073741824" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:38 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b Sep 06 22:50:38 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:39 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63635a13-aafd-4d8d-a850-710cbe056764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c485c4a-310a-4e56-b8bd-0f327091bc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Volume volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b (31ef3230-e143-41d2-9bc9-41bd58d8e73b): created successfully Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c485c4a-310a-4e56-b8bd-0f327091bc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Flow 'volume_create_manager' (a400b03a-b7ac-44fc-bb2b-a790aa696fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fbcddfb7-cb6d-4c5f-b777-60f8f5a9f134 tempest-AttachVolumeNegativeTest-1990295743 None] Created volume successfully. Sep 06 22:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c3d364bc-51af-4804-a8cb-195e5c995307 req-d5c49f22-e4fc-483e-815f-663eca647b65 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c3d364bc-51af-4804-a8cb-195e5c995307 req-d5c49f22-e4fc-483e-815f-663eca647b65 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c3d364bc-51af-4804-a8cb-195e5c995307 req-d5c49f22-e4fc-483e-815f-663eca647b65 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c3d364bc-51af-4804-a8cb-195e5c995307 req-d5c49f22-e4fc-483e-815f-663eca647b65 tempest-AttachVolumeNegativeTest-1990295743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52b88baa-d298-4012-a404-d739df63c1f3', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:50:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c3d364bc-51af-4804-a8cb-195e5c995307 req-d5c49f22-e4fc-483e-815f-663eca647b65 tempest-AttachVolumeNegativeTest-1990295743 None] attachment_update completed successfully. Sep 06 22:50:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-bc0601a5-2a9f-4796-a213-432bc5bf6156 req-78f895de-1987-4203-865e-05eca957b7a9 tempest-AttachVolumeNegativeTest-1990295743 None] Terminate volume connection completed successfully. Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-bc0601a5-2a9f-4796-a213-432bc5bf6156 req-78f895de-1987-4203-865e-05eca957b7a9 tempest-AttachVolumeNegativeTest-1990295743 None] Deleting attachment 52b88baa-d298-4012-a404-d739df63c1f3. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Flow 'volume_create_manager' (4b8a2eb0-97f2-4d93-90c0-b92e4dbb08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5402ab4d-532f-4137-8460-7b6f3fb64e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5402ab4d-532f-4137-8460-7b6f3fb64e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ce010-f299-48c3-8c19-a7b0e27420a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b01fc4585694787b85b0ddd1203cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:45Z,use_quota=True,user_id='dfaa50130bcc45f9aa4cce0114798b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc63902b-54f4-44e8-80f1-2bb8b257fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc63902b-54f4-44e8-80f1-2bb8b257fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac214e1-4616-4493-8ba1-60a51c93bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac214e1-4616-4493-8ba1-60a51c93bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441ce010-f299-48c3-8c19-a7b0e27420a4', 'volume_name': 'volume-441ce010-f299-48c3-8c19-a7b0e27420a4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2a39bd-6cc7-4058-b320-139a348d1ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2a39bd-6cc7-4058-b320-139a348d1ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15717ef5-f6f6-4dfa-93d8-8e0b1d007f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Volume 441ce010-f299-48c3-8c19-a7b0e27420a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441ce010-f299-48c3-8c19-a7b0e27420a4', 'volume_size': 1} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ce010-f299-48c3-8c19-a7b0e27420a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b01fc4585694787b85b0ddd1203cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:45Z,use_quota=True,user_id='dfaa50130bcc45f9aa4cce0114798b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Creating volume 441ce010-f299-48c3-8c19-a7b0e27420a4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:44 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:44 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 1073741824 Sep 06 22:50:44 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:45 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 1073741824" returned: 0 in 0.567s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:45 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 Sep 06 22:50:45 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:45 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15717ef5-f6f6-4dfa-93d8-8e0b1d007f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441ce010-f299-48c3-8c19-a7b0e27420a4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb786f1-22b6-4d93-a993-344c5bc6b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Volume volume-441ce010-f299-48c3-8c19-a7b0e27420a4 (441ce010-f299-48c3-8c19-a7b0e27420a4): created successfully Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb786f1-22b6-4d93-a993-344c5bc6b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Flow 'volume_create_manager' (4b8a2eb0-97f2-4d93-90c0-b92e4dbb08ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f29a3824-b5d5-4057-9974-f30e57686cbe tempest-CinderUnicodeTest-1942333012 None] Created volume successfully. Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Flow 'volume_create_manager' (5c3682a7-628f-4ab6-8dbc-7eaebea7e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec40908-9317-4638-a5fc-246dcb1c2dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec40908-9317-4638-a5fc-246dcb1c2dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1379504575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48535866-90f1-4b5e-a024-fc1d68b6dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b01fc4585694787b85b0ddd1203cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:47Z,use_quota=True,user_id='dfaa50130bcc45f9aa4cce0114798b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f5c246-5e16-4746-a74b-52a2cacfc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f5c246-5e16-4746-a74b-52a2cacfc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c076d7-8225-4096-92b0-ecf5f15d1a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c076d7-8225-4096-92b0-ecf5f15d1a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48535866-90f1-4b5e-a024-fc1d68b6dd07', 'volume_name': 'volume-48535866-90f1-4b5e-a024-fc1d68b6dd07', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5aff409-1143-4d70-a70a-15b87d9ae6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5aff409-1143-4d70-a70a-15b87d9ae6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3c23e-3bcc-4c4c-a23d-395190f0b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Volume 48535866-90f1-4b5e-a024-fc1d68b6dd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48535866-90f1-4b5e-a024-fc1d68b6dd07', 'volume_size': 1} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:50:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1379504575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48535866-90f1-4b5e-a024-fc1d68b6dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b01fc4585694787b85b0ddd1203cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:50:47Z,use_quota=True,user_id='dfaa50130bcc45f9aa4cce0114798b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Creating volume 48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:50:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:50:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:47 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 1073741824 Sep 06 22:50:47 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:48 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 1073741824" returned: 0 in 0.646s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:48 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 Sep 06 22:50:48 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:48 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3c23e-3bcc-4c4c-a23d-395190f0b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48535866-90f1-4b5e-a024-fc1d68b6dd07', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091c403a-167c-4039-9df1-745e4a6fc0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:50:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Volume volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 (48535866-90f1-4b5e-a024-fc1d68b6dd07): created successfully Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091c403a-167c-4039-9df1-745e4a6fc0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:50:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Flow 'volume_create_manager' (5c3682a7-628f-4ab6-8dbc-7eaebea7e801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:50:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d980780c-c661-4ba1-9f50-7523c719a544 tempest-CinderUnicodeTest-1942333012 None] Created volume successfully. Sep 06 22:50:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Creating offline snapshot e9982046-bd55-47e4-95ca-d324ffe62ad6 of volume 48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:50:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b9a77e-9aa6-4520-840f-3eed3c77c17b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:50 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 Sep 06 22:50:50 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-31ef3230-e143-41d2-9bc9-41bd58d8e73b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-31ef3230-e143-41d2-9bc9-41bd58d8e73b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-quobyte-31ef3230-e143-41d2-9bc9-41bd58d8e73b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-31ef3230-e143-41d2-9bc9-41bd58d8e73b" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375b5c3-ce0b-4308-a294-775213b428e2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:50 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b Sep 06 22:50:50 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:50 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07" returned: 0 in 0.654s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:50 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 1G Sep 06 22:50:50 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:50 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b" returned: 0 in 0.566s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:50 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b Sep 06 22:50:50 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:51 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 1G" returned: 0 in 0.644s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:51 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 Sep 06 22:50:51 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:51 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-31ef3230-e143-41d2-9bc9-41bd58d8e73b" returned: 0 in 0.332s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-31ef3230-e143-41d2-9bc9-41bd58d8e73b" released by "delete_volume" :: held 0.960s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Created reservations ['c5998856-6333-4b89-954e-7e9824c8c452', 'ac29f783-b222-4bd0-9679-b6336c0a671e', 'b7ff5ecb-f554-4612-8c3f-b025d205e94a', '3832298d-7fcd-4bfc-92ab-b5906bb47ca0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:51 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:51 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:51 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6" returned: 0 in 0.520s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 is being set with open permissions: ugo+rw Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:51 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 Sep 06 22:50:51 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:51 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Deleted volume successfully. Sep 06 22:50:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6786c9da-7b1c-4b40-b4cc-50646858227c tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-31ef3230-e143-41d2-9bc9-41bd58d8e73b-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:52 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:52 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info Sep 06 22:50:52 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:52 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:52 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info is being set with open permissions: ugo+rw Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:52 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info Sep 06 22:50:52 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-c356224c-9038-4472-9024-21dac8ec3944-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-c356224c-9038-4472-9024-21dac8ec3944-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:52 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.info" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.972s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-quobyte-c356224c-9038-4472-9024-21dac8ec3944" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-c356224c-9038-4472-9024-21dac8ec3944" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eebde81a-eabf-4d98-ac1f-881b2b7f2021 tempest-CinderUnicodeTest-1942333012 None] Create snapshot completed successfully Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0b226-97c4-4677-9f06-e1c49a8e3f1e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:53 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 Sep 06 22:50:53 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-e9982046-bd55-47e4-95ca-d324ffe62ad6-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-e9982046-bd55-47e4-95ca-d324ffe62ad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-quobyte-e9982046-bd55-47e4-95ca-d324ffe62ad6" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-e9982046-bd55-47e4-95ca-d324ffe62ad6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Deleting offline snapshot e9982046-bd55-47e4-95ca-d324ffe62ad6 of volume 48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] snapshot_file for this snap is: volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bdcfca-3cea-4cc5-88b6-783efec1364b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:53 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 Sep 06 22:50:53 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:53 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944" returned: 0 in 0.548s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:53 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944 Sep 06 22:50:53 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:53 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48535866-90f1-4b5e-a024-fc1d68b6dd07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5f172-ee2b-486c-908b-4a39d96c4ddd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:53 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c356224c-9038-4472-9024-21dac8ec3944" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-c356224c-9038-4472-9024-21dac8ec3944" released by "delete_volume" :: held 0.962s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:53 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Created reservations ['d8b28ccc-4e53-405d-924e-2be0f8bc067a', '4893562b-1392-491a-9877-03e27716cdf5', 'e5cd6ca6-a638-497e-ae7c-1281d2bda9d3', '442473e3-4fc1-414f-a93b-54a6e12eac10'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:53 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 Sep 06 22:50:53 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:54 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:54 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:54 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07" returned: 0 in 0.632s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:54 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 Sep 06 22:50:54 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:54 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.459s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Deleted volume successfully. Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5390d37-2269-48a8-a2de-6e6c68b99278 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-c356224c-9038-4472-9024-21dac8ec3944-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:54 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6" returned: 0 in 0.584s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:54 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6 Sep 06 22:50:54 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-ba636192-d74f-4045-9b77-ca9b3e33ed78-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-ba636192-d74f-4045-9b77-ca9b3e33ed78-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:55 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07.e9982046-bd55-47e4-95ca-d324ffe62ad6" returned: 0 in 0.402s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "cinder-quobyte-ba636192-d74f-4045-9b77-ca9b3e33ed78" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-e9982046-bd55-47e4-95ca-d324ffe62ad6" released by "_delete_snapshot" :: held 2.240s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" released by "delete_snapshot" :: held 2.277s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-ba636192-d74f-4045-9b77-ca9b3e33ed78" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f21d9-1459-451c-b4f8-c344ffea1604]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Created reservations ['4c174082-bd4d-4c45-b4e7-0bf227a29917', '8c828525-678e-481d-9e6d-fce87103a698', '05ffd8fb-6582-4553-97dd-57e5b6811ffd', '262bc299-5433-45ef-9c9f-8185f1b8d76e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Delete snapshot completed successfully. Sep 06 22:50:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5e48e55c-ae8d-4038-97ac-9cae384a2473 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-e9982046-bd55-47e4-95ca-d324ffe62ad6-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:55 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 Sep 06 22:50:55 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:56 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78" returned: 0 in 0.672s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:56 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78 Sep 06 22:50:56 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:56 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ba636192-d74f-4045-9b77-ca9b3e33ed78" returned: 0 in 0.654s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-quobyte-ba636192-d74f-4045-9b77-ca9b3e33ed78" released by "delete_volume" :: held 1.416s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-48535866-90f1-4b5e-a024-fc1d68b6dd07-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-48535866-90f1-4b5e-a024-fc1d68b6dd07-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Created reservations ['8c82c094-d1b2-4276-a684-f840f193dfea', '18ba3def-ae20-4654-bb26-24c9a2f1400d', 'bd4bdef2-14a7-4fd7-8692-ef34632f920f', '440590b1-0ebe-484d-b154-94c58d0a569b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1399ec0-dde8-4c30-8138-468131ce7279]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:57 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:57 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:57 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 Sep 06 22:50:57 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:57 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.613s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:58 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Deleted volume successfully. Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07" returned: 0 in 0.766s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-521ec191-94c2-43b5-ac60-fef488481521 tempest-AttachVolumeNegativeTest-1990295743 None] Lock "cinder-ba636192-d74f-4045-9b77-ca9b3e33ed78-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:58 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07 Sep 06 22:50:58 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:58 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-48535866-90f1-4b5e-a024-fc1d68b6dd07" returned: 0 in 0.508s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-48535866-90f1-4b5e-a024-fc1d68b6dd07" released by "delete_volume" :: held 1.454s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Created reservations ['eb910882-4035-43e0-9add-9f51e57c1fbd', '9b41f7f4-b33d-435c-ab85-49cf9cc46d78', 'af2333e8-8c73-4e69-a181-98ee3a576004', '5ec13ea1-6c8f-4733-a448-942fb03809db'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:50:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:58 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:50:58 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:50:59 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:50:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Deleted volume successfully. Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30a956ec-6911-4aa6-ae3f-88da9c4a82a9 tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-48535866-90f1-4b5e-a024-fc1d68b6dd07-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-441ce010-f299-48c3-8c19-a7b0e27420a4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-441ce010-f299-48c3-8c19-a7b0e27420a4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "cinder-quobyte-441ce010-f299-48c3-8c19-a7b0e27420a4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-441ce010-f299-48c3-8c19-a7b0e27420a4" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa32e7b-04b0-44a4-b4d0-9c96642407a7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:50:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:50:59 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 Sep 06 22:50:59 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:00 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4" returned: 0 in 0.640s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:00 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4 Sep 06 22:51:00 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:00 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-441ce010-f299-48c3-8c19-a7b0e27420a4" returned: 0 in 0.621s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-quobyte-441ce010-f299-48c3-8c19-a7b0e27420a4" released by "delete_volume" :: held 1.340s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Created reservations ['fe68f884-bf03-41ce-ab33-0b8605d7d661', '9ce590da-cf54-4756-ba8a-c85ef97c17ee', '2eeac90d-81fc-4627-9bbe-8762145c25db', 'a572dac0-e9b4-4039-85b4-96afafaea8e7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:01 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:01 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:01 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Deleted volume successfully. Sep 06 22:51:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c90b4ba-556d-4015-9196-dd165e3bde4b tempest-CinderUnicodeTest-1942333012 None] Lock "cinder-441ce010-f299-48c3-8c19-a7b0e27420a4-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:05 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:05 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:06 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.497s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:51:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=93,cinder:INSERT=33,cinder:UPDATE=128,cinder:DELETE=11 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:51:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=95,cinder:UPDATE=134,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (2045280c-8a60-4425-a24c-993e24850a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa49d4d-d802-47e3-b788-5062b57d2cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa49d4d-d802-47e3-b788-5062b57d2cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890604844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25024c0-97c1-42cd-8b10-4b3b5e358e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:16Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2e8837-18bc-423b-946b-196bdbe00b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2e8837-18bc-423b-946b-196bdbe00b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b10cd-1ce4-40d5-8ee8-237b42d855af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b10cd-1ce4-40d5-8ee8-237b42d855af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25024c0-97c1-42cd-8b10-4b3b5e358e3c', 'volume_name': 'volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a367c86-f250-4912-9e3c-6f6b871de265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a367c86-f250-4912-9e3c-6f6b871de265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437bd3a5-7c92-43dd-9f63-c14efe33d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Volume b25024c0-97c1-42cd-8b10-4b3b5e358e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c', 'volume_size': 1} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890604844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25024c0-97c1-42cd-8b10-4b3b5e358e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:16Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Creating volume b25024c0-97c1-42cd-8b10-4b3b5e358e3c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:16 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c 1073741824 Sep 06 22:51:16 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:17 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c 1073741824" returned: 0 in 0.726s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:17 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c Sep 06 22:51:17 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" returned: 0 in 0.564s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:17 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437bd3a5-7c92-43dd-9f63-c14efe33d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae20f95-e9e7-4c11-a125-4f41e1d1e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Volume volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c (b25024c0-97c1-42cd-8b10-4b3b5e358e3c): created successfully Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae20f95-e9e7-4c11-a125-4f41e1d1e998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (2045280c-8a60-4425-a24c-993e24850a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c4dc8dd4-29b3-4458-b960-113b20f3da40 tempest-ProjectReaderTests-1063858483 None] Created volume successfully. Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-b25024c0-97c1-42cd-8b10-4b3b5e358e3c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-b25024c0-97c1-42cd-8b10-4b3b5e358e3c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9a461706-019a-4989-8501-a0fc9847fee8 tempest-BackendsCapabilitiesAdminTestsJSON-584072013 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6511421203613, 'free_capacity_gb': 1773.6511421203613, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-quobyte-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2764dfe4-8958-44aa-bfb0-01e2c16c5313 tempest-BackendsCapabilitiesAdminTestsJSON-584072013 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6511421203613, 'free_capacity_gb': 1773.6511421203613, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[241e7901-2b82-4fab-85d1-2f5831792564]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:19 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c Sep 06 22:51:19 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:19 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" returned: 0 in 0.611s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:19 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c Sep 06 22:51:19 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:20 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-b25024c0-97c1-42cd-8b10-4b3b5e358e3c" released by "delete_volume" :: held 1.055s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Created reservations ['e01a9bd9-7e32-4e8a-b62f-5cbc2366c9ad', 'a721c5a7-f8b4-4d36-a4ee-a78c297dacd5', '0d40d407-d16d-4088-af42-5f1f1f8b8a03', 'a7324fd2-31a1-4b5e-a698-1042f1c94093'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:20 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:20 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:20 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Deleted volume successfully. Sep 06 22:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-410c5e98-6a82-4643-a9b3-0be37185a0c4 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-b25024c0-97c1-42cd-8b10-4b3b5e358e3c-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (1481fd15-954e-4443-b774-ea5c44d15d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35313e5d-2a92-4c46-83b0-86d7e0a41238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35313e5d-2a92-4c46-83b0-86d7e0a41238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736758021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71283dbe-363c-48d7-add9-3e432bd21faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:22Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4272ace6-cfe0-4c9c-b597-caf5a9670d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4272ace6-cfe0-4c9c-b597-caf5a9670d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ecb1b6-aff4-4d28-8666-1c58dc3071fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ecb1b6-aff4-4d28-8666-1c58dc3071fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71283dbe-363c-48d7-add9-3e432bd21faa', 'volume_name': 'volume-71283dbe-363c-48d7-add9-3e432bd21faa', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08555592-6a34-41fb-8823-350d22b12963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08555592-6a34-41fb-8823-350d22b12963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1818c15-5751-443e-a547-357f3b5895e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Volume 71283dbe-363c-48d7-add9-3e432bd21faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71283dbe-363c-48d7-add9-3e432bd21faa', 'volume_size': 1} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736758021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71283dbe-363c-48d7-add9-3e432bd21faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:22Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Creating volume 71283dbe-363c-48d7-add9-3e432bd21faa {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:22 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:22 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa 1073741824 Sep 06 22:51:22 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:22 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa 1073741824" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:22 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa Sep 06 22:51:22 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:23 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1818c15-5751-443e-a547-357f3b5895e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71283dbe-363c-48d7-add9-3e432bd21faa', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b7d9d5-4451-41f5-846a-a1e8111112e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Volume volume-71283dbe-363c-48d7-add9-3e432bd21faa (71283dbe-363c-48d7-add9-3e432bd21faa): created successfully Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b7d9d5-4451-41f5-846a-a1e8111112e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (1481fd15-954e-4443-b774-ea5c44d15d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1043d38d-7e75-4d44-9fb1-e1f54ba555da tempest-ProjectReaderTests-1063858483 None] Created volume successfully. Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-71283dbe-363c-48d7-add9-3e432bd21faa-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "cinder-71283dbe-363c-48d7-add9-3e432bd21faa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-quobyte-71283dbe-363c-48d7-add9-3e432bd21faa" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-71283dbe-363c-48d7-add9-3e432bd21faa" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8296a07-5406-4ec1-b60e-4cd3778012bf]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Flow 'volume_create_manager' (b06bf6c3-997d-4f1f-b7b1-98a43d14dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c29b15-966e-4369-adee-713f7842c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c29b15-966e-4369-adee-713f7842c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-840405800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd506e2f2054db2a020fbd1c3da14bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:25Z,use_quota=True,user_id='b5743eb79cd645ee802b0f2dfec9adbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4f293e-01a0-427a-9c36-6d7d4cd53d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4f293e-01a0-427a-9c36-6d7d4cd53d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:24 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa Sep 06 22:51:24 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40d2c40-875f-423f-87d7-e4cb30f5fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40d2c40-875f-423f-87d7-e4cb30f5fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4', 'volume_name': 'volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57fec6-0d72-4de1-846d-6d122add313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b57fec6-0d72-4de1-846d-6d122add313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfc7dd4-2518-4a28-ba0c-f9f5656150c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Volume 71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4', 'volume_size': 1} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-840405800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd506e2f2054db2a020fbd1c3da14bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:25Z,use_quota=True,user_id='b5743eb79cd645ee802b0f2dfec9adbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Creating volume 71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:24 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:24 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 1073741824 Sep 06 22:51:24 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:25 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:25 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa Sep 06 22:51:25 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:25 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 1073741824" returned: 0 in 0.559s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:25 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71283dbe-363c-48d7-add9-3e432bd21faa" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-71283dbe-363c-48d7-add9-3e432bd21faa" released by "delete_volume" :: held 0.821s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:25 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 Sep 06 22:51:25 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Created reservations ['a4022e0e-dd4a-4e9f-82aa-00215ab24fe6', '047f1786-f472-4743-88ea-8592578982f6', '0ae1060d-192a-40ad-a407-d1175a8d5e5a', 'fee95c8b-a0ef-4d41-b23a-51e4fe790aba'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:25 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:25 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:26 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Deleted volume successfully. Sep 06 22:51:26 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" returned: 0 in 0.524s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfc7dd4-2518-4a28-ba0c-f9f5656150c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00afd1-cb0d-47c5-ad95-323a122036f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d0252a0-8cb8-4537-8d9b-892ee6f70bbd tempest-ProjectReaderTests-1063858483 None] Lock "cinder-71283dbe-363c-48d7-add9-3e432bd21faa-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Volume volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 (71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4): created successfully Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00afd1-cb0d-47c5-ad95-323a122036f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Flow 'volume_create_manager' (b06bf6c3-997d-4f1f-b7b1-98a43d14dd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eaa855f1-d74b-4e78-a136-74e67f04401e tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Created volume successfully. Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (bb1d1ee3-0fda-43eb-9a2e-be07ff894e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0584b7a-0f77-4afc-9e54-c2c73730ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0584b7a-0f77-4afc-9e54-c2c73730ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682229722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29ab96-0153-45e7-8ad3-be359fc00f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:26Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d2d6da-8598-44cf-a680-cc37caf4f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d2d6da-8598-44cf-a680-cc37caf4f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12580cbb-3cac-49d9-a04b-0ab56d5f58c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12580cbb-3cac-49d9-a04b-0ab56d5f58c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a29ab96-0153-45e7-8ad3-be359fc00f54', 'volume_name': 'volume-7a29ab96-0153-45e7-8ad3-be359fc00f54', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefbeb8c-2232-490f-b79d-f40d0687ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefbeb8c-2232-490f-b79d-f40d0687ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd37e0c-d4d8-49a2-985e-3178b892d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Volume 7a29ab96-0153-45e7-8ad3-be359fc00f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a29ab96-0153-45e7-8ad3-be359fc00f54', 'volume_size': 1} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682229722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29ab96-0153-45e7-8ad3-be359fc00f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:26Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Creating volume 7a29ab96-0153-45e7-8ad3-be359fc00f54 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:26 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 1073741824 Sep 06 22:51:26 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:27 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 1073741824" returned: 0 in 0.613s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:27 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 Sep 06 22:51:27 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-954535ba-0293-4d57-a093-ad3784445051 req-6417bd08-f865-4523-b038-709986ca57ad tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:27 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-954535ba-0293-4d57-a093-ad3784445051 req-6417bd08-f865-4523-b038-709986ca57ad tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.129s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-954535ba-0293-4d57-a093-ad3784445051 req-6417bd08-f865-4523-b038-709986ca57ad tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd37e0c-d4d8-49a2-985e-3178b892d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a29ab96-0153-45e7-8ad3-be359fc00f54', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cbdafa-4f8d-4b81-9cc7-642ba0fd7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Volume volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 (7a29ab96-0153-45e7-8ad3-be359fc00f54): created successfully Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cbdafa-4f8d-4b81-9cc7-642ba0fd7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (bb1d1ee3-0fda-43eb-9a2e-be07ff894e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-954535ba-0293-4d57-a093-ad3784445051 req-6417bd08-f865-4523-b038-709986ca57ad tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c61aaa3-28c2-44fa-8038-16bb1584a768', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:51:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12401ab1-a10f-43c4-9d5d-975abe55584a tempest-ProjectReaderTests-1063858483 None] Created volume successfully. Sep 06 22:51:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-954535ba-0293-4d57-a093-ad3784445051 req-6417bd08-f865-4523-b038-709986ca57ad tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] attachment_update completed successfully. Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-7a29ab96-0153-45e7-8ad3-be359fc00f54-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-7a29ab96-0153-45e7-8ad3-be359fc00f54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-quobyte-7a29ab96-0153-45e7-8ad3-be359fc00f54" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-7a29ab96-0153-45e7-8ad3-be359fc00f54" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[62242f05-68d3-4e50-aacb-bb7b66e90734]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:29 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 Sep 06 22:51:29 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:29 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:29 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54 Sep 06 22:51:29 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:29 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a29ab96-0153-45e7-8ad3-be359fc00f54" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-7a29ab96-0153-45e7-8ad3-be359fc00f54" released by "delete_volume" :: held 0.740s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Created reservations ['1e991f4b-73f1-4e08-8e01-d65db32297a4', '4f980560-da2e-4d10-965b-e5846e96fb14', 'ea624c29-5396-4d01-bf19-d54e3dcfec6d', 'ead97423-82dd-4a8f-bf31-d1c72786e48b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:29 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:29 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:30 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Deleted volume successfully. Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2fad7ffa-9495-4ff1-8fee-f5a5c14459f9 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-7a29ab96-0153-45e7-8ad3-be359fc00f54-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (b2ff9e9f-58d8-49d5-83c7-bca0325a0c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ac009-90dc-4114-9be2-750c146bcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ac009-90dc-4114-9be2-750c146bcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697223256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67aeecd5-a5da-4041-8bb5-5b070d16e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:31Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e2805a-d5d7-43d9-ad0a-d9096a2f8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e2805a-d5d7-43d9-ad0a-d9096a2f8bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b36e92-dbe6-4f84-b667-3e24bf3dacc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b36e92-dbe6-4f84-b667-3e24bf3dacc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67aeecd5-a5da-4041-8bb5-5b070d16e559', 'volume_name': 'volume-67aeecd5-a5da-4041-8bb5-5b070d16e559', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64349986-0b9e-4d8b-ab85-7fce98a811ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64349986-0b9e-4d8b-ab85-7fce98a811ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540c7b88-d8cf-4881-a966-d9403bf5219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Volume 67aeecd5-a5da-4041-8bb5-5b070d16e559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67aeecd5-a5da-4041-8bb5-5b070d16e559', 'volume_size': 1} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697223256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67aeecd5-a5da-4041-8bb5-5b070d16e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad1178a938d44079683d68e5a041335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:31Z,use_quota=True,user_id='5274459dfe1d494b8f09aa71a13f2622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Creating volume 67aeecd5-a5da-4041-8bb5-5b070d16e559 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:30 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:30 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 1073741824 Sep 06 22:51:30 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:31 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 1073741824" returned: 0 in 0.494s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:31 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 Sep 06 22:51:31 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-20939203-cfed-4c1d-aef0-5869d83a2800 req-7fa2c24b-fe07-401b-8c82-2f85b2c16a7a tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Terminate volume connection completed successfully. Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-20939203-cfed-4c1d-aef0-5869d83a2800 req-7fa2c24b-fe07-401b-8c82-2f85b2c16a7a tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Deleting attachment 3c61aaa3-28c2-44fa-8038-16bb1584a768. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:51:31 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540c7b88-d8cf-4881-a966-d9403bf5219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67aeecd5-a5da-4041-8bb5-5b070d16e559', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7f4079-7fa6-4945-9cd7-b261b907ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Volume volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 (67aeecd5-a5da-4041-8bb5-5b070d16e559): created successfully Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7f4079-7fa6-4945-9cd7-b261b907ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Flow 'volume_create_manager' (b2ff9e9f-58d8-49d5-83c7-bca0325a0c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fb6523df-d841-45cb-8e96-9741494cc8f1 tempest-ProjectReaderTests-1063858483 None] Created volume successfully. Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "cinder-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "cinder-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "cinder-quobyte-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "cinder-quobyte-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870d812-5428-44a9-8cae-f9d08779d506]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:32 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 Sep 06 22:51:32 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:32 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:32 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4 Sep 06 22:51:32 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-67aeecd5-a5da-4041-8bb5-5b070d16e559-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-67aeecd5-a5da-4041-8bb5-5b070d16e559-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "cinder-quobyte-67aeecd5-a5da-4041-8bb5-5b070d16e559" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-67aeecd5-a5da-4041-8bb5-5b070d16e559" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f7ebf-d3c0-42a5-b951-37401c21d90a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:32 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:32 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 Sep 06 22:51:33 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "cinder-quobyte-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4" released by "delete_volume" :: held 0.717s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Created reservations ['dd6658dd-ed61-4450-96bd-2394a475e3c7', 'e42bec15-ea48-4a6c-a541-f5cdf35eea8f', '671a55de-6445-49c0-9b6b-0cbd4fe380b2', 'b15a8c18-905b-4681-b4ea-c24ffa9f53c3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:33 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:33 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:33 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:33 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559 Sep 06 22:51:33 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:33 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Deleted volume successfully. Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5cfe2d8-b8da-467c-8215-80d9d1447ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1936405485 None] Lock "cinder-71a5a6b6-b160-4dbb-84b6-4f1b2327bcb4-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-423baf39-ecd6-40c2-abec-762e7e0e5505 tempest-GroupsTest-1280536338 None] Group tempest-Group1-1770387504: creating Sep 06 22:51:33 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-67aeecd5-a5da-4041-8bb5-5b070d16e559" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-quobyte-67aeecd5-a5da-4041-8bb5-5b070d16e559" released by "delete_volume" :: held 0.820s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-423baf39-ecd6-40c2-abec-762e7e0e5505 tempest-GroupsTest-1280536338 None] Group tempest-Group1-1770387504: created successfully Sep 06 22:51:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-423baf39-ecd6-40c2-abec-762e7e0e5505 tempest-GroupsTest-1280536338 None] Create group completed successfully. Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Created reservations ['a97344c9-fded-41e9-aaae-75f8e1fb3481', '0557099d-5b53-4d1e-a4b0-654d67a2e51c', '11b1f666-4c63-4ad8-878e-27437289e23b', '2984f43c-9284-4eef-959c-0a077a166516'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:33 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:33 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:34 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Deleted volume successfully. Sep 06 22:51:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ccd92f0-da25-41f7-bc80-ced0bbf2ef25 tempest-ProjectReaderTests-1063858483 None] Lock "cinder-67aeecd5-a5da-4041-8bb5-5b070d16e559-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47764425-4647-4b57-aa6f-4073d04ad13c tempest-GroupsTest-1280536338 None] Group tempest-Group2-346088780: creating Sep 06 22:51:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47764425-4647-4b57-aa6f-4073d04ad13c tempest-GroupsTest-1280536338 None] Group tempest-Group2-346088780: created successfully Sep 06 22:51:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47764425-4647-4b57-aa6f-4073d04ad13c tempest-GroupsTest-1280536338 None] Create group completed successfully. Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (c41b950d-992d-451c-91e1-82f079598bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5335df7-5b58-4feb-94a9-1397e20eda3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5335df7-5b58-4feb-94a9-1397e20eda3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800889912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73140727-074f-470f-a9de-f938a4e25b0b,host='devstack@QuobyteHD#QuobyteHD',id=b09e4bc7-9a5f-4a02-b505-ca96911cabba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:37Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7fb8388-2f4c-40cc-9dda-2661dbdde19f),volume_type_id=d7fb8388-2f4c-40cc-9dda-2661dbdde19f)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee749068-cca8-46df-8a05-9d42ec9a6779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee749068-cca8-46df-8a05-9d42ec9a6779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e2a31a-5c60-49b7-a4dc-aebd617b268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e2a31a-5c60-49b7-a4dc-aebd617b268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09e4bc7-9a5f-4a02-b505-ca96911cabba', 'volume_name': 'volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b517e172-56f7-4ca3-8f74-364bd7d94106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b517e172-56f7-4ca3-8f74-364bd7d94106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8f3606-d3b4-43b5-b97a-4087c0e1dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Volume b09e4bc7-9a5f-4a02-b505-ca96911cabba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba', 'volume_size': 1} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73140727-074f-470f-a9de-f938a4e25b0b,created_at=2026-09-06T20:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800889912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73140727-074f-470f-a9de-f938a4e25b0b,host='devstack@QuobyteHD#QuobyteHD',id=b09e4bc7-9a5f-4a02-b505-ca96911cabba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:37Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7fb8388-2f4c-40cc-9dda-2661dbdde19f),volume_type_id=d7fb8388-2f4c-40cc-9dda-2661dbdde19f)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Creating volume b09e4bc7-9a5f-4a02-b505-ca96911cabba {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:36 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba 1073741824 Sep 06 22:51:36 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:37 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba 1073741824" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:37 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba Sep 06 22:51:37 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:37 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8f3606-d3b4-43b5-b97a-4087c0e1dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e46dd-9b23-4bb8-a2ed-563165ae877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Volume volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba (b09e4bc7-9a5f-4a02-b505-ca96911cabba): created successfully Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e46dd-9b23-4bb8-a2ed-563165ae877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (c41b950d-992d-451c-91e1-82f079598bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a05e5f6f-543c-4a6e-b108-5c3ba4d51ad9 tempest-GroupsTest-1280536338 None] Created volume successfully. Sep 06 22:51:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Acquiring lock "cinder-quobyte-b09e4bc7-9a5f-4a02-b505-ca96911cabba" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-b09e4bc7-9a5f-4a02-b505-ca96911cabba" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa8c44f-7415-4fd4-a983-a74c8c62d469]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:39 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba Sep 06 22:51:39 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:39 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba" returned: 0 in 0.536s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:39 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba Sep 06 22:51:39 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:39 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b09e4bc7-9a5f-4a02-b505-ca96911cabba" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-b09e4bc7-9a5f-4a02-b505-ca96911cabba" released by "delete_volume" :: held 1.030s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (73d9304b-9446-4528-810b-def5c1938b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7863c7ff-0258-4fe8-a618-77c4317dc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7863c7ff-0258-4fe8-a618-77c4317dc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-26353622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829e7194-85f0-4a51-a860-42571155c84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:40Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e3fe6e-7c63-493c-8bbd-283908131a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e3fe6e-7c63-493c-8bbd-283908131a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b400a4-b3c1-4b74-a213-e73afaf23343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b400a4-b3c1-4b74-a213-e73afaf23343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829e7194-85f0-4a51-a860-42571155c84f', 'volume_name': 'volume-829e7194-85f0-4a51-a860-42571155c84f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3ee902-15a3-4485-8805-05f8223af98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3ee902-15a3-4485-8805-05f8223af98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906c6ec3-c6e1-4a73-a379-3108a3d8821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Volume 829e7194-85f0-4a51-a860-42571155c84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829e7194-85f0-4a51-a860-42571155c84f', 'volume_size': 1} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-26353622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829e7194-85f0-4a51-a860-42571155c84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:40Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Creating volume 829e7194-85f0-4a51-a860-42571155c84f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:40 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:40 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f 1073741824 Sep 06 22:51:40 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Created reservations ['048e1056-1759-46f2-ac69-ad3e10769a26'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:40 devstack cinder-volume[87517]: WARNING cinder.quota [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-36564349 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-36564349, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:51:40 devstack cinder-volume[87517]: WARNING cinder.quota [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-36564349 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-36564349, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Created reservations ['0d27c0bd-ab78-4eca-8f20-0e4de4438ca2', '25bbf56f-872d-4ffc-96c0-b82815eccb51', '6fb4c609-6950-4ae3-8303-dfdecaa9d936', 'b5ce3f27-c9c1-401d-8c8e-6151fed43b16'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:40 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:40 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:40 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f 1073741824" returned: 0 in 0.582s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:40 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a306c07a-e0f4-48fe-8e78-c9bb70ee6331 tempest-GroupsTest-1280536338 None] Delete group completed successfully. Sep 06 22:51:40 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f Sep 06 22:51:40 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:40 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906c6ec3-c6e1-4a73-a379-3108a3d8821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829e7194-85f0-4a51-a860-42571155c84f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315bf579-0126-4aed-bd2e-28fe2788c999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Volume volume-829e7194-85f0-4a51-a860-42571155c84f (829e7194-85f0-4a51-a860-42571155c84f): created successfully Sep 06 22:51:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315bf579-0126-4aed-bd2e-28fe2788c999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (73d9304b-9446-4528-810b-def5c1938b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-45ad2e07-4ddd-444e-98c3-2e5923efe2a1 tempest-AttachVolumeTestJSON-646915831 None] Created volume successfully. Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Created reservations ['3e0d9321-ad2d-412f-adae-bd7f3671d5ba'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:41 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:41 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:41 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cd577cbe-d4e5-4b0e-af80-adc5eb225847 tempest-GroupsTest-1280536338 None] Delete group completed successfully. Sep 06 22:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-96d55e94-21dd-4158-86fd-85f0c07154ba req-068d8f27-1231-4f2b-952b-b48d8275fb49 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-96d55e94-21dd-4158-86fd-85f0c07154ba req-068d8f27-1231-4f2b-952b-b48d8275fb49 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-96d55e94-21dd-4158-86fd-85f0c07154ba req-068d8f27-1231-4f2b-952b-b48d8275fb49 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-96d55e94-21dd-4158-86fd-85f0c07154ba req-068d8f27-1231-4f2b-952b-b48d8275fb49 tempest-AttachVolumeTestJSON-646915831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-829e7194-85f0-4a51-a860-42571155c84f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25d22fa3-62e5-4508-ad8f-b7f8a56b136d', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:51:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-96d55e94-21dd-4158-86fd-85f0c07154ba req-068d8f27-1231-4f2b-952b-b48d8275fb49 tempest-AttachVolumeTestJSON-646915831 None] attachment_update completed successfully. Sep 06 22:51:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6a4e6207-0e8b-48e5-a255-74d4f6a262a4 tempest-GroupsTest-1280536338 None] Group tempest-GroupsTest-Group-680862940: creating Sep 06 22:51:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6a4e6207-0e8b-48e5-a255-74d4f6a262a4 tempest-GroupsTest-1280536338 None] Group tempest-GroupsTest-Group-680862940: created successfully Sep 06 22:51:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6a4e6207-0e8b-48e5-a255-74d4f6a262a4 tempest-GroupsTest-1280536338 None] Create group completed successfully. Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (4406feed-54d0-4a44-8639-9434a74dd4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2339b73f-216b-4895-ae22-f8ea7cd174fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2339b73f-216b-4895-ae22-f8ea7cd174fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004578252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09635ad8-cee6-4931-b73d-c945878c6b67,host='devstack@QuobyteHD#QuobyteHD',id=c4cd287d-25a9-469d-a984-11a75a619a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:45Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(375cfcd9-bec3-452a-b498-32b0b5788cc2),volume_type_id=375cfcd9-bec3-452a-b498-32b0b5788cc2)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d57f1a-9564-4ef5-b441-d5dbc1a913a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d57f1a-9564-4ef5-b441-d5dbc1a913a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ec8c6-f160-491e-8ee1-44f63c639154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ec8c6-f160-491e-8ee1-44f63c639154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cd287d-25a9-469d-a984-11a75a619a0b', 'volume_name': 'volume-c4cd287d-25a9-469d-a984-11a75a619a0b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9529251-02d3-4ae9-a209-5247d3db35d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9529251-02d3-4ae9-a209-5247d3db35d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c77553-b99e-4a38-ab77-c63f49671e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Volume c4cd287d-25a9-469d-a984-11a75a619a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cd287d-25a9-469d-a984-11a75a619a0b', 'volume_size': 1} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09635ad8-cee6-4931-b73d-c945878c6b67,created_at=2026-09-06T20:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004578252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09635ad8-cee6-4931-b73d-c945878c6b67,host='devstack@QuobyteHD#QuobyteHD',id=c4cd287d-25a9-469d-a984-11a75a619a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:45Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(375cfcd9-bec3-452a-b498-32b0b5788cc2),volume_type_id=375cfcd9-bec3-452a-b498-32b0b5788cc2)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Creating volume c4cd287d-25a9-469d-a984-11a75a619a0b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:45 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:45 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b 1073741824 Sep 06 22:51:45 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:45 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b 1073741824" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:46 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b Sep 06 22:51:46 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:46 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c77553-b99e-4a38-ab77-c63f49671e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cd287d-25a9-469d-a984-11a75a619a0b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b49d3-3c7a-441d-97db-9f434975818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Volume volume-c4cd287d-25a9-469d-a984-11a75a619a0b (c4cd287d-25a9-469d-a984-11a75a619a0b): created successfully Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b49d3-3c7a-441d-97db-9f434975818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (4406feed-54d0-4a44-8639-9434a74dd4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9b76a478-3ecc-4c9d-b65d-fa1dc14322cd tempest-GroupsTest-1280536338 None] Created volume successfully. Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (4bff1d1b-b682-4e17-a535-93374fc27829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dcb8e9-f9b6-4971-ae8d-7ac33d676d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dcb8e9-f9b6-4971-ae8d-7ac33d676d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858186961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09635ad8-cee6-4931-b73d-c945878c6b67,host='devstack@QuobyteHD#QuobyteHD',id=fe5be758-d737-48da-a34d-fcea82ffc288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:48Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(375cfcd9-bec3-452a-b498-32b0b5788cc2),volume_type_id=375cfcd9-bec3-452a-b498-32b0b5788cc2)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a253c7c3-47e1-4140-9e7c-28fd77d36160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a253c7c3-47e1-4140-9e7c-28fd77d36160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6002a010-4182-400e-8138-31830a170b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6002a010-4182-400e-8138-31830a170b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5be758-d737-48da-a34d-fcea82ffc288', 'volume_name': 'volume-fe5be758-d737-48da-a34d-fcea82ffc288', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72afa824-41ef-4904-9f7c-09007e3e7bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72afa824-41ef-4904-9f7c-09007e3e7bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432394ae-d988-43d7-9b3c-f6d6a263ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Volume fe5be758-d737-48da-a34d-fcea82ffc288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5be758-d737-48da-a34d-fcea82ffc288', 'volume_size': 1} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09635ad8-cee6-4931-b73d-c945878c6b67,created_at=2026-09-06T20:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858186961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09635ad8-cee6-4931-b73d-c945878c6b67,host='devstack@QuobyteHD#QuobyteHD',id=fe5be758-d737-48da-a34d-fcea82ffc288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8531e9973d924cd69ca411a31198ea01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:48Z,use_quota=True,user_id='8ee67700f6bc489585abacf965c44255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(375cfcd9-bec3-452a-b498-32b0b5788cc2),volume_type_id=375cfcd9-bec3-452a-b498-32b0b5788cc2)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Creating volume fe5be758-d737-48da-a34d-fcea82ffc288 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:48 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:48 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 1073741824 Sep 06 22:51:48 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:49 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 1073741824" returned: 0 in 0.555s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:49 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 Sep 06 22:51:49 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:49 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432394ae-d988-43d7-9b3c-f6d6a263ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5be758-d737-48da-a34d-fcea82ffc288', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acae4a-a385-49d7-ab7b-9a87679c45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Volume volume-fe5be758-d737-48da-a34d-fcea82ffc288 (fe5be758-d737-48da-a34d-fcea82ffc288): created successfully Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acae4a-a385-49d7-ab7b-9a87679c45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Flow 'volume_create_manager' (4bff1d1b-b682-4e17-a535-93374fc27829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e1eef1e5-85c6-4f1f-ac54-c7d0a469f43a tempest-GroupsTest-1280536338 None] Created volume successfully. Sep 06 22:51:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f4c72a0f-ce3c-49d8-bb12-74c2390e02ad tempest-GroupsTest-1280536338 None] Update group completed successfully. Sep 06 22:51:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a9438032-897f-4424-9bf1-65a1ae783305 tempest-GroupsTest-1280536338 None] Update group completed successfully. Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Acquiring lock "cinder-quobyte-c4cd287d-25a9-469d-a984-11a75a619a0b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-c4cd287d-25a9-469d-a984-11a75a619a0b" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b7afd2-3b13-4204-896d-7aaaf7a7b680]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:54 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b Sep 06 22:51:54 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:54 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b" returned: 0 in 0.687s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:54 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b Sep 06 22:51:54 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:55 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c4cd287d-25a9-469d-a984-11a75a619a0b" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-c4cd287d-25a9-469d-a984-11a75a619a0b" released by "delete_volume" :: held 1.056s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Acquiring lock "cinder-quobyte-fe5be758-d737-48da-a34d-fcea82ffc288" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-fe5be758-d737-48da-a34d-fcea82ffc288" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cda90e-32bb-4f9f-a178-a63445a66ab1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:55 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 Sep 06 22:51:55 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:55 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288" returned: 0 in 0.805s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:56 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288 Sep 06 22:51:56 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (4be1d1be-ce2c-408d-a00c-7d9e75e2ecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9496dc2-0a4e-437a-9ef2-6a58a200bd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9496dc2-0a4e-437a-9ef2-6a58a200bd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58766073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f337b22d-4321-47a2-98aa-8b3bd83dff00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:56Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0fd9c5-c220-4bfa-b820-7c52cf7675fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0fd9c5-c220-4bfa-b820-7c52cf7675fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7813238a-232d-4f52-99dc-d6db8a84cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7813238a-232d-4f52-99dc-d6db8a84cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f337b22d-4321-47a2-98aa-8b3bd83dff00', 'volume_name': 'volume-f337b22d-4321-47a2-98aa-8b3bd83dff00', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35598370-4d93-480e-9d22-05357d043787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35598370-4d93-480e-9d22-05357d043787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cd4e6e-cca3-4922-8ef9-d1b0cb7a7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Volume f337b22d-4321-47a2-98aa-8b3bd83dff00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f337b22d-4321-47a2-98aa-8b3bd83dff00', 'volume_size': 1} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58766073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f337b22d-4321-47a2-98aa-8b3bd83dff00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:56Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Creating volume f337b22d-4321-47a2-98aa-8b3bd83dff00 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:56 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:56 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fe5be758-d737-48da-a34d-fcea82ffc288" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:56 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 1073741824 Sep 06 22:51:56 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "cinder-quobyte-fe5be758-d737-48da-a34d-fcea82ffc288" released by "delete_volume" :: held 1.368s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:51:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Created reservations ['e6ee53cb-27a1-4ebe-bcd5-02f8b4c546b0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:56 devstack cinder-volume[87517]: WARNING cinder.quota [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1422566723 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1422566723, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:51:56 devstack cinder-volume[87517]: WARNING cinder.quota [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1422566723 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1422566723, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Created reservations ['da8f7371-2c15-421b-ac66-e9ac512983a1', '3c380180-47b3-4138-b73e-03b9598988d1', 'c89344c9-da20-4301-aeb9-45a06ecf9067', 'bcfc0a55-5895-4162-843f-c9eb20545c4c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (19473ee5-abcb-4005-9b93-1861a9a817a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dace56-8c07-4d35-ab01-72c459392d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dace56-8c07-4d35-ab01-72c459392d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1820925937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab1dcd2-3dec-4de6-87b3-99fb1bf93846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:57Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a7a367-8d14-4d59-93f6-746fdaeff563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a7a367-8d14-4d59-93f6-746fdaeff563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762ca181-8351-4707-ba51-c941e1d961cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762ca181-8351-4707-ba51-c941e1d961cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab1dcd2-3dec-4de6-87b3-99fb1bf93846', 'volume_name': 'volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a77f6c9-d975-40bf-969c-a7d51bc0300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a77f6c9-d975-40bf-969c-a7d51bc0300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e70f3e-556e-4e6f-838d-1b5c99b40baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Volume 0ab1dcd2-3dec-4de6-87b3-99fb1bf93846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846', 'volume_size': 1} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:57 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 1073741824" returned: 0 in 0.973s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:57 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 Sep 06 22:51:57 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Created reservations ['f8b2face-7d51-45d6-adda-2df648664539', 'a131758b-4f7b-4e83-a466-a9d016c11e5f', 'aae1b652-f72a-4512-82ad-331a273f485f', '5b59cd88-88fa-498f-b23f-7c1e01fb7f51'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:57 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:57 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:57 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1820925937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab1dcd2-3dec-4de6-87b3-99fb1bf93846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:57Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Creating volume 0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cd4e6e-cca3-4922-8ef9-d1b0cb7a7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f337b22d-4321-47a2-98aa-8b3bd83dff00', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:57 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 1073741824 Sep 06 22:51:57 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96869495-fe75-44c6-8ed9-5b84f63805a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Volume volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 (f337b22d-4321-47a2-98aa-8b3bd83dff00): created successfully Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96869495-fe75-44c6-8ed9-5b84f63805a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (4be1d1be-ce2c-408d-a00c-7d9e75e2ecf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-330c3a4f-2992-4d30-b301-3aaa868d1ab0 tempest-CreateVolumesFromImageTest-1596931160 None] Created volume successfully. Sep 06 22:51:58 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:51:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f737f1f7-a075-4bcf-a124-f3ea3bebb0d6 tempest-GroupsTest-1280536338 None] Delete group completed successfully. Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (0d7c3544-c6ed-406f-9ba0-12efeeda36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0a5e35-61b3-4a0c-8adc-3dbe4c39e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0a5e35-61b3-4a0c-8adc-3dbe4c39e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194456086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3393c934-bfa0-4477-9818-f7e568f849b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:58Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a888eaa6-602c-4399-9b55-f0147351c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a888eaa6-602c-4399-9b55-f0147351c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2b6d03-692f-40ed-b1b4-63844dd2ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2b6d03-692f-40ed-b1b4-63844dd2ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3393c934-bfa0-4477-9818-f7e568f849b1', 'volume_name': 'volume-3393c934-bfa0-4477-9818-f7e568f849b1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9c340-d3af-4b7b-97b6-e6e31660cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9c340-d3af-4b7b-97b6-e6e31660cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb5d5b8-3bc5-4187-b0dd-0f0ed93187dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Volume 3393c934-bfa0-4477-9818-f7e568f849b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3393c934-bfa0-4477-9818-f7e568f849b1', 'volume_size': 1} Sep 06 22:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (5c8f3bec-c2ad-4e4e-b6ad-258117a3d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd77762a-d8e0-4bbc-b42b-b1b6a23df6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd77762a-d8e0-4bbc-b42b-b1b6a23df6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560476513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62af3762-1e21-4e44-9649-b745f7eb74dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:59Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b74a99-d887-4ac1-aa4f-9c2874186110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b74a99-d887-4ac1-aa4f-9c2874186110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11c575-2063-4b37-958e-1fbdec7df5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11c575-2063-4b37-958e-1fbdec7df5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62af3762-1e21-4e44-9649-b745f7eb74dd', 'volume_name': 'volume-62af3762-1e21-4e44-9649-b745f7eb74dd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c00363-fed7-4174-b40d-a1304c350651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c00363-fed7-4174-b40d-a1304c350651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06b5046-71b4-4f49-85f9-c96937654ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Volume 62af3762-1e21-4e44-9649-b745f7eb74dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62af3762-1e21-4e44-9649-b745f7eb74dd', 'volume_size': 1} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 1073741824" returned: 0 in 1.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:59 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 Sep 06 22:51:59 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:59 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194456086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3393c934-bfa0-4477-9818-f7e568f849b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:58Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Creating volume 3393c934-bfa0-4477-9818-f7e568f849b1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:51:59 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e70f3e-556e-4e6f-838d-1b5c99b40baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a59dabe-932c-4790-b8e0-d00872b6b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 1073741824 Sep 06 22:51:59 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:51:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Volume volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 (0ab1dcd2-3dec-4de6-87b3-99fb1bf93846): created successfully Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a59dabe-932c-4790-b8e0-d00872b6b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (19473ee5-abcb-4005-9b93-1861a9a817a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ebde357d-64fb-4737-b779-5c62bd58d671 tempest-CreateVolumesFromImageTest-1596931160 None] Created volume successfully. Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (5ade0ffa-4cc0-4a98-a898-deb51f514d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b787f700-5da6-43bc-8652-641627c40b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b787f700-5da6-43bc-8652-641627c40b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790855277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117cdb00-4c82-476e-8257-696676464a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:00Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0fabfd-c6d5-481d-9f3e-ceb43c45a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0fabfd-c6d5-481d-9f3e-ceb43c45a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aec659-68e0-401a-82b7-df9527ea1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aec659-68e0-401a-82b7-df9527ea1d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117cdb00-4c82-476e-8257-696676464a88', 'volume_name': 'volume-117cdb00-4c82-476e-8257-696676464a88', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f69ee4-ad48-445e-b9f0-9f019c596ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f69ee4-ad48-445e-b9f0-9f019c596ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f19853a-9cdb-491e-9e42-ac9c398455d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:51:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Volume 117cdb00-4c82-476e-8257-696676464a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117cdb00-4c82-476e-8257-696676464a88', 'volume_size': 1} Sep 06 22:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:00 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 1073741824" returned: 0 in 0.663s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:00 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 Sep 06 22:52:00 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:00 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1" returned: 0 in 0.533s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560476513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62af3762-1e21-4e44-9649-b745f7eb74dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:51:59Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Creating volume 62af3762-1e21-4e44-9649-b745f7eb74dd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:00 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:01 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd 1073741824 Sep 06 22:52:01 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb5d5b8-3bc5-4187-b0dd-0f0ed93187dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3393c934-bfa0-4477-9818-f7e568f849b1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d782b3-f8eb-49d5-b846-09bfb49ae26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Volume volume-3393c934-bfa0-4477-9818-f7e568f849b1 (3393c934-bfa0-4477-9818-f7e568f849b1): created successfully Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d782b3-f8eb-49d5-b846-09bfb49ae26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (0d7c3544-c6ed-406f-9ba0-12efeeda36b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ff23c00d-92fb-4797-8302-f8163f21377f tempest-CreateVolumesFromImageTest-1596931160 None] Created volume successfully. Sep 06 22:52:01 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd 1073741824" returned: 0 in 0.689s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:01 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd Sep 06 22:52:01 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:02 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790855277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117cdb00-4c82-476e-8257-696676464a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1152f41468024ea2a43707a7ede210be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:00Z,use_quota=True,user_id='190e297a7dbd4e739b78d5e7edef1c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Creating volume 117cdb00-4c82-476e-8257-696676464a88 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:02 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06b5046-71b4-4f49-85f9-c96937654ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62af3762-1e21-4e44-9649-b745f7eb74dd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:02 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 1073741824 Sep 06 22:52:02 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39547d56-84fc-40b3-aba1-005d2ba56983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Volume volume-62af3762-1e21-4e44-9649-b745f7eb74dd (62af3762-1e21-4e44-9649-b745f7eb74dd): created successfully Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39547d56-84fc-40b3-aba1-005d2ba56983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (5c8f3bec-c2ad-4e4e-b6ad-258117a3d81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3698e7c0-2126-4087-aa13-05b63019bc06 tempest-CreateVolumesFromImageTest-1596931160 None] Created volume successfully. Sep 06 22:52:02 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 1073741824" returned: 0 in 0.834s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:03 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 Sep 06 22:52:03 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:03 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f19853a-9cdb-491e-9e42-ac9c398455d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117cdb00-4c82-476e-8257-696676464a88', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2b076e-752e-437e-b859-5fad1aa4d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Volume volume-117cdb00-4c82-476e-8257-696676464a88 (117cdb00-4c82-476e-8257-696676464a88): created successfully Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2b076e-752e-437e-b859-5fad1aa4d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Flow 'volume_create_manager' (5ade0ffa-4cc0-4a98-a898-deb51f514d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-51167902-23fd-4962-aca1-d071ba0c1864 tempest-CreateVolumesFromImageTest-1596931160 None] Created volume successfully. Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-117cdb00-4c82-476e-8257-696676464a88-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-117cdb00-4c82-476e-8257-696676464a88-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-quobyte-117cdb00-4c82-476e-8257-696676464a88" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-117cdb00-4c82-476e-8257-696676464a88" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[761c3384-83e2-4740-a50c-d8ce5a3b54a0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:04 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 Sep 06 22:52:04 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:04 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:04 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88 Sep 06 22:52:04 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:04 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-117cdb00-4c82-476e-8257-696676464a88" returned: 0 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-117cdb00-4c82-476e-8257-696676464a88" released by "delete_volume" :: held 0.962s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Created reservations ['75016fc5-986a-4ebc-917a-daf3dd6c7340', '59685f21-ea27-4113-a729-0f7cda036dc5', 'f6b42e86-92ca-40a7-830a-b5af0d3690e5', '012aa1ea-882b-4ef5-9819-2bc01c1c9a3a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:05 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:05 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:05 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Deleted volume successfully. Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c81933c0-4d1c-475f-afa0-a06ab3632fd4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-117cdb00-4c82-476e-8257-696676464a88-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-62af3762-1e21-4e44-9649-b745f7eb74dd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-62af3762-1e21-4e44-9649-b745f7eb74dd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-quobyte-62af3762-1e21-4e44-9649-b745f7eb74dd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-62af3762-1e21-4e44-9649-b745f7eb74dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[783004ec-6cb9-4968-a6dc-63bb46fabfa2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:06 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd Sep 06 22:52:06 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:06 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd" returned: 0 in 0.645s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:06 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd Sep 06 22:52:06 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:07 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-62af3762-1e21-4e44-9649-b745f7eb74dd" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-62af3762-1e21-4e44-9649-b745f7eb74dd" released by "delete_volume" :: held 1.114s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Created reservations ['afbc7f20-7511-4d87-8f95-52853a96ee51', '23307bdf-c49b-43f8-a491-311994b723f2', 'de0f8fa2-6ec2-465f-8be0-329c5aa083fd', '7dc0c8b9-d937-4f02-9283-da7e3c84823e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:07 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:07 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:07 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Deleted volume successfully. Sep 06 22:52:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-495b565f-605a-4c41-be1b-bfc069d91a2d tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-62af3762-1e21-4e44-9649-b745f7eb74dd-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-3393c934-bfa0-4477-9818-f7e568f849b1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-3393c934-bfa0-4477-9818-f7e568f849b1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-quobyte-3393c934-bfa0-4477-9818-f7e568f849b1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-3393c934-bfa0-4477-9818-f7e568f849b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b91b8e5-7882-4ed6-8c75-854839a1b730]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:08 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 Sep 06 22:52:08 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:09 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:09 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1 Sep 06 22:52:09 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:09 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3393c934-bfa0-4477-9818-f7e568f849b1" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-3393c934-bfa0-4477-9818-f7e568f849b1" released by "delete_volume" :: held 0.973s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Flow 'volume_create_manager' (826c270c-3365-409f-adc7-4415c2e9576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a791-131f-409e-8ba2-ef44af2b98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a791-131f-409e-8ba2-ef44af2b98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1034601616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27370543-20e5-4899-9902-f399c109ce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab4c3c563cc43bcaaa50bf0e6a2c470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:09Z,use_quota=True,user_id='d560a52f4dd5463b97410f5b752a54d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd4cdaa-44af-4dbb-81cf-180bb251de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd4cdaa-44af-4dbb-81cf-180bb251de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf540c7d-5d7f-4e80-846f-5029a8fd944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf540c7d-5d7f-4e80-846f-5029a8fd944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27370543-20e5-4899-9902-f399c109ce9b', 'volume_name': 'volume-27370543-20e5-4899-9902-f399c109ce9b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885da6b6-6ec4-4071-b55f-b93858ffbc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885da6b6-6ec4-4071-b55f-b93858ffbc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be17486-1774-4403-b5b1-ca3a794744d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume 27370543-20e5-4899-9902-f399c109ce9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27370543-20e5-4899-9902-f399c109ce9b', 'volume_size': 1} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1034601616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27370543-20e5-4899-9902-f399c109ce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab4c3c563cc43bcaaa50bf0e6a2c470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:09Z,use_quota=True,user_id='d560a52f4dd5463b97410f5b752a54d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Creating volume 27370543-20e5-4899-9902-f399c109ce9b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:09 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:09 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b 1073741824 Sep 06 22:52:09 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Created reservations ['e6f59c71-bf7f-460e-894a-d7233d553883', 'a6b9dd76-f530-494e-b6ef-8f14b2ab8f3d', 'f47f3c9a-6497-4b56-98b3-47033f521645', 'f520f615-53f6-4b3a-86b5-c7f6516561a5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:09 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:09 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:10 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Deleted volume successfully. Sep 06 22:52:10 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b 1073741824" returned: 0 in 0.468s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af3f71bc-f8e5-4b89-8327-141521a59aa4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-3393c934-bfa0-4477-9818-f7e568f849b1-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:10 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b Sep 06 22:52:10 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:10 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be17486-1774-4403-b5b1-ca3a794744d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27370543-20e5-4899-9902-f399c109ce9b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a9253-9df6-4ed0-a41b-f78bebd97043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume volume-27370543-20e5-4899-9902-f399c109ce9b (27370543-20e5-4899-9902-f399c109ce9b): created successfully Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a9253-9df6-4ed0-a41b-f78bebd97043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Flow 'volume_create_manager' (826c270c-3365-409f-adc7-4415c2e9576b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-58d17f43-27d5-423d-ac30-7c5eed2f28b5 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Created volume successfully. Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "cinder-27370543-20e5-4899-9902-f399c109ce9b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "cinder-27370543-20e5-4899-9902-f399c109ce9b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Flow 'volume_create_manager' (5a04b6ef-c9a8-42ed-adf0-cda138e4be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e74485-cec2-4777-8e23-4d2a4cef16ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e74485-cec2-4777-8e23-4d2a4cef16ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1852214942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe936fe-4b99-42e5-a9fa-a1f13e781ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e7022c19a4b5295e58c63607a815d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:11Z,use_quota=True,user_id='a087376d2cc847e8b70b0e67c8459f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55877f1b-628f-4a9a-b92f-34dc9b9f9a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55877f1b-628f-4a9a-b92f-34dc9b9f9a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d08d1-221b-4cc7-9197-a0c56f0efbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d08d1-221b-4cc7-9197-a0c56f0efbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe936fe-4b99-42e5-a9fa-a1f13e781ae7', 'volume_name': 'volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c614c11-e763-4acc-af21-170bb31e8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c614c11-e763-4acc-af21-170bb31e8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be26b68-5e31-41fe-a48e-c2774f2101cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Volume abe936fe-4b99-42e5-a9fa-a1f13e781ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7', 'volume_size': 1} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1852214942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe936fe-4b99-42e5-a9fa-a1f13e781ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e7022c19a4b5295e58c63607a815d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:11Z,use_quota=True,user_id='a087376d2cc847e8b70b0e67c8459f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Creating volume abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:10 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 1073741824 Sep 06 22:52:10 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "cinder-quobyte-27370543-20e5-4899-9902-f399c109ce9b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "cinder-quobyte-27370543-20e5-4899-9902-f399c109ce9b" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-quobyte-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f0916-6b79-453d-871a-24433197dda7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c058c66-eee1-4fa3-addf-a12a1c62943e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b Sep 06 22:52:11 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 Sep 06 22:52:11 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 1073741824" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=121,cinder:UPDATE=151,cinder:DELETE=13,cinder:INSERT=31 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:52:11 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b Sep 06 22:52:11 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:11 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846 Sep 06 22:52:11 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:11 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-27370543-20e5-4899-9902-f399c109ce9b" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be26b68-5e31-41fe-a48e-c2774f2101cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb8f8e0-d465-401a-a0f0-24598abcd5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:11 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "cinder-quobyte-27370543-20e5-4899-9902-f399c109ce9b" released by "delete_volume" :: held 0.756s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Volume volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 (abe936fe-4b99-42e5-a9fa-a1f13e781ae7): created successfully Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb8f8e0-d465-401a-a0f0-24598abcd5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Flow 'volume_create_manager' (5a04b6ef-c9a8-42ed-adf0-cda138e4be4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846" released by "delete_volume" :: held 0.733s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-66acf88a-1db4-47a1-9447-46af2d5bb8e7 tempest-SnapshotDependencyTests-1372993445 None] Created volume successfully. Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=130,cinder:UPDATE=155,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Created reservations ['71fdf508-be20-42e1-814b-8da8c34a4e18', '6cc824cb-89f6-458b-8ee5-e4ff03ad2822', '171fb606-22ef-4a97-b343-c9c1d9f2723f', '44c465f9-3107-41b7-b3d7-b032a46ab1f5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Created reservations ['18f04d3d-ed85-4513-96d6-fccce31b6a3e', '6800d7b9-16d0-48f9-a6c2-2ac603a072ce', '0238a8b9-7a9a-4571-ab90-31ce7bb41e1f', '1214d865-3230-47df-9cae-41801bc8406a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:11 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-f337b22d-4321-47a2-98aa-8b3bd83dff00-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:11 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:11 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-f337b22d-4321-47a2-98aa-8b3bd83dff00-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "cinder-quobyte-f337b22d-4321-47a2-98aa-8b3bd83dff00" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-f337b22d-4321-47a2-98aa-8b3bd83dff00" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[529353e0-3e9f-429e-8ded-4c50af16265f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:12 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 Sep 06 22:52:12 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:12 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Deleted volume successfully. Sep 06 22:52:12 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f240fe8e-5780-4cc4-b2ec-6efe7c77ce55 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "cinder-27370543-20e5-4899-9902-f399c109ce9b-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Deleted volume successfully. Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8bb1f161-b277-4ab7-94b0-ca35d32079c4 tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-0ab1dcd2-3dec-4de6-87b3-99fb1bf93846-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:12 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:12 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00 Sep 06 22:52:12 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:12 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f337b22d-4321-47a2-98aa-8b3bd83dff00" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-quobyte-f337b22d-4321-47a2-98aa-8b3bd83dff00" released by "delete_volume" :: held 0.673s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Created reservations ['5e271664-20b0-40fe-8f4b-f73fe59ef584', '2c1a9fbf-7b00-42b7-9292-250ad09784e0', '9964ed32-ae98-46ed-9db5-fe0305e46e17', '4039d816-9aa3-4e9d-90ed-1998fac82625'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:12 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:12 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Creating offline snapshot 74441c80-9670-416e-9b2a-0f408c17bade of volume abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff742d7c-f85e-4154-a4f5-72d563e19179]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:13 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Deleted volume successfully. Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-701141ab-73f3-4a02-8be1-c64106452e2e tempest-CreateVolumesFromImageTest-1596931160 None] Lock "cinder-f337b22d-4321-47a2-98aa-8b3bd83dff00-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:13 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:13 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:13 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Flow 'volume_create_manager' (17eab085-9077-43cb-ba5e-0c3e155f95cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c08190-5d78-4861-aefb-e77f693e1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c08190-5d78-4861-aefb-e77f693e1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-220858628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3149e66-fdba-47b4-8901-9b159ab379ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab4c3c563cc43bcaaa50bf0e6a2c470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:13Z,use_quota=True,user_id='d560a52f4dd5463b97410f5b752a54d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:13 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade 1G Sep 06 22:52:13 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c28149-526c-49f8-b3c0-2820884ff766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c28149-526c-49f8-b3c0-2820884ff766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1870ad5b-d9a4-4ca6-9f0e-01888af44b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1870ad5b-d9a4-4ca6-9f0e-01888af44b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3149e66-fdba-47b4-8901-9b159ab379ad', 'volume_name': 'volume-e3149e66-fdba-47b4-8901-9b159ab379ad', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff58c6d-ab7c-4c36-a38c-c65f868bca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff58c6d-ab7c-4c36-a38c-c65f868bca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e11bebb-6a6f-4b9d-a01b-5ff3e57e0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume e3149e66-fdba-47b4-8901-9b159ab379ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3149e66-fdba-47b4-8901-9b159ab379ad', 'volume_size': 1} Sep 06 22:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:14 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade 1G" returned: 0 in 0.508s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:14 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:14 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:14 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade is being set with open permissions: ugo+rw Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:14 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:14 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:14 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:14 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info Sep 06 22:52:14 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:15 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info is being set with open permissions: ugo+rw Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:15 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info Sep 06 22:52:15 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:15 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.info" returned: 0 in 0.285s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-220858628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3149e66-fdba-47b4-8901-9b159ab379ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab4c3c563cc43bcaaa50bf0e6a2c470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:13Z,use_quota=True,user_id='d560a52f4dd5463b97410f5b752a54d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Creating volume e3149e66-fdba-47b4-8901-9b159ab379ad {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:15 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad 1073741824 Sep 06 22:52:15 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b45bfa44-116e-4c41-af1e-906be0d985c8 tempest-SnapshotDependencyTests-1372993445 None] Create snapshot completed successfully Sep 06 22:52:15 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad 1073741824" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:15 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad Sep 06 22:52:15 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:16 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e11bebb-6a6f-4b9d-a01b-5ff3e57e0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3149e66-fdba-47b4-8901-9b159ab379ad', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faab032-fa8a-451c-a52e-b58cc19eb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Volume volume-e3149e66-fdba-47b4-8901-9b159ab379ad (e3149e66-fdba-47b4-8901-9b159ab379ad): created successfully Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faab032-fa8a-451c-a52e-b58cc19eb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Flow 'volume_create_manager' (17eab085-9077-43cb-ba5e-0c3e155f95cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6da37a07-fc37-4a7a-896f-b1dba66813b7 tempest-VolumeQuotasAdminTestJSON-1332678143 None] Created volume successfully. Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (fb59b6d3-6e4f-469c-ad1f-c9cea005676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6e7cee-0d3d-4f4c-a6e5-e7aa7bf8e671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6e7cee-0d3d-4f4c-a6e5-e7aa7bf8e671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866197864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b585b3-a21f-4380-9ef7-572f44e972fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:16Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0128dba6-1236-4b5c-a6f1-26a74241f713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0128dba6-1236-4b5c-a6f1-26a74241f713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b85bb7-f6e9-4124-ae39-1de9a7a5109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b85bb7-f6e9-4124-ae39-1de9a7a5109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b585b3-a21f-4380-9ef7-572f44e972fb', 'volume_name': 'volume-26b585b3-a21f-4380-9ef7-572f44e972fb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07136f8b-2107-4ddd-afba-c04a6c82383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07136f8b-2107-4ddd-afba-c04a6c82383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342be549-b39a-4a5f-a380-f541b14ab358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume 26b585b3-a21f-4380-9ef7-572f44e972fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b585b3-a21f-4380-9ef7-572f44e972fb', 'volume_size': 1} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866197864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b585b3-a21f-4380-9ef7-572f44e972fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:16Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume 26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:16 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb 1073741824 Sep 06 22:52:16 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-470c5622-3c2e-4895-921f-ad249f83cd12 req-16665389-1670-46d8-bd1e-03210ed2c4e7 tempest-AttachVolumeTestJSON-646915831 None] Terminate volume connection completed successfully. Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-470c5622-3c2e-4895-921f-ad249f83cd12 req-16665389-1670-46d8-bd1e-03210ed2c4e7 tempest-AttachVolumeTestJSON-646915831 None] Deleting attachment 25d22fa3-62e5-4508-ad8f-b7f8a56b136d. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Flow 'volume_create_manager' (ea1dfdef-e9c0-4b19-b754-2d3f43fe22da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d799a7-3edd-48cd-9c81-6d86d43d48b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d799a7-3edd-48cd-9c81-6d86d43d48b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b38be8-b1f1-4257-b31b-dbbf102dc9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e7022c19a4b5295e58c63607a815d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74441c80-9670-416e-9b2a-0f408c17bade,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:17Z,use_quota=True,user_id='a087376d2cc847e8b70b0e67c8459f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31378e6-fb69-49bd-88e7-fb125fd70653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31378e6-fb69-49bd-88e7-fb125fd70653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429ebdd0-1589-4dc5-b644-65c35c84eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429ebdd0-1589-4dc5-b644-65c35c84eed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76b38be8-b1f1-4257-b31b-dbbf102dc9b2', 'volume_name': 'volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2', 'volume_size': 1, 'snapshot_id': '74441c80-9670-416e-9b2a-0f408c17bade'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5b5378-9072-478a-ba02-6ef408d7d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5b5378-9072-478a-ba02-6ef408d7d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891a31e0-4aa0-42c4-8866-86e1fc7928ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Volume 76b38be8-b1f1-4257-b31b-dbbf102dc9b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2', 'volume_size': 1, 'snapshot_id': '74441c80-9670-416e-9b2a-0f408c17bade'} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:17 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb 1073741824" returned: 0 in 0.574s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:17 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb Sep 06 22:52:17 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:17 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.320s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342be549-b39a-4a5f-a380-f541b14ab358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b585b3-a21f-4380-9ef7-572f44e972fb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5474dec-6a4f-4396-adc4-04768e4c0c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Creating volume 76b38be8-b1f1-4257-b31b-dbbf102dc9b2 from snapshot 74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-26b585b3-a21f-4380-9ef7-572f44e972fb (26b585b3-a21f-4380-9ef7-572f44e972fb): created successfully Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5474dec-6a4f-4396-adc4-04768e4c0c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (fb59b6d3-6e4f-469c-ad1f-c9cea005676c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] snapshot: 74441c80-9670-416e-9b2a-0f408c17bade, volume: 76b38be8-b1f1-4257-b31b-dbbf102dc9b2, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:52:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-51d622be-406b-4574-bebf-7b9e8f8d9a66 tempest-VolumeQuotasAdminTestJSON-470030643 None] Transfer volume completed successfully. Sep 06 22:52:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8aed662c-fbbb-4f47-a108-926c3ba1e6cd tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[052fb4b0-49d7-49c1-803d-b076970fc8dc]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:17 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:17 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:18 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d30e2-9c69-40e9-836c-7b99d61446da]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Acquiring lock "cinder-e3149e66-fdba-47b4-8901-9b159ab379ad-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "cinder-e3149e66-fdba-47b4-8901-9b159ab379ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:18 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:18 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Acquiring lock "cinder-quobyte-e3149e66-fdba-47b4-8901-9b159ab379ad" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "cinder-quobyte-e3149e66-fdba-47b4-8901-9b159ab379ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b74d6-b006-4fc2-b019-326eb73dd34b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:18 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad Sep 06 22:52:18 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:18 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:18 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 Sep 06 22:52:18 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:18 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:18 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad Sep 06 22:52:18 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:18 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e3149e66-fdba-47b4-8901-9b159ab379ad" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "cinder-quobyte-e3149e66-fdba-47b4-8901-9b159ab379ad" released by "delete_volume" :: held 0.758s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Created reservations ['46965d29-5f84-4124-a479-60dbdf4e164d', 'ba3e3359-4570-4f2a-a1a8-94aff34aea49', 'ece81423-ade8-4395-a490-e43cf0e8a69b', '8fbf34c8-64fa-41ca-b67a-4097dd5dd4ad'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:19 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:19 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:20 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.948s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Deleted volume successfully. Sep 06 22:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b90fe487-d343-4349-98f7-28761c31162d tempest-VolumeQuotasAdminTestJSON-1454466435 None] Lock "cinder-e3149e66-fdba-47b4-8901-9b159ab379ad-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:24 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" returned: 0 in 6.326s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:24 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:52:24 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Converted 1024.00 MB image at 161.85 MB/s Sep 06 22:52:24 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 is being set with open permissions: ugo+rw Sep 06 22:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:24 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 Sep 06 22:52:24 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:25 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" released by "_copy_volume_from_snapshot" :: held 7.838s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" released by "_create_volume_from_snapshot" :: held 7.938s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.968s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.648s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating offline snapshot 72be583e-28b7-4264-95e0-10e909e814a2 of volume 26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891a31e0-4aa0-42c4-8866-86e1fc7928ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2', 'volume_size': 1, 'snapshot_id': '74441c80-9670-416e-9b2a-0f408c17bade'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e0faf8-2c03-4dcc-ae22-aae8c15450a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63cdd1-5798-4fe4-aa7a-bd1c781b89b7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Volume volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 (76b38be8-b1f1-4257-b31b-dbbf102dc9b2): created successfully Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e0faf8-2c03-4dcc-ae22-aae8c15450a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Flow 'volume_create_manager' (ea1dfdef-e9c0-4b19-b754-2d3f43fe22da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f47837b2-69f0-4219-9d57-da45ba04c129 tempest-SnapshotDependencyTests-1372993445 None] Created volume successfully. Sep 06 22:52:25 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb Sep 06 22:52:25 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:25 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb" returned: 0 in 0.555s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:26 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 1G Sep 06 22:52:26 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-74441c80-9670-416e-9b2a-0f408c17bade-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-74441c80-9670-416e-9b2a-0f408c17bade-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Deleting offline snapshot 74441c80-9670-416e-9b2a-0f408c17bade of volume abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] snapshot_file for this snap is: volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a55d9-faa4-4d95-b8a5-9772480fddd7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:26 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:26 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:26 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 1G" returned: 0 in 0.752s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b585b3-a21f-4380-9ef7-572f44e972fb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:26 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b585b3-a21f-4380-9ef7-572f44e972fb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 Sep 06 22:52:26 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:27 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.538s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f82bc4b-a98b-4b2e-ba42-7d70e9a54e8c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:27 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b585b3-a21f-4380-9ef7-572f44e972fb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2" returned: 0 in 0.483s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:27 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 is being set with open permissions: ugo+rw Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:27 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 Sep 06 22:52:27 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:27 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:27 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:27 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2" returned: 0 in 0.493s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:27 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info Sep 06 22:52:27 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:27 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.808s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:27 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:27 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:28 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:28 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info is being set with open permissions: ugo+rw Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:28 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info Sep 06 22:52:28 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:28 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:28 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.info" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.497s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:28 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade Sep 06 22:52:28 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2f000ae2-0899-43c6-b0ed-98b900853d77 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Create snapshot completed successfully Sep 06 22:52:28 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7.74441c80-9670-416e-9b2a-0f408c17bade" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-74441c80-9670-416e-9b2a-0f408c17bade" released by "_delete_snapshot" :: held 2.333s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" released by "delete_snapshot" :: held 2.386s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Created reservations ['865ffaf1-7b1b-489a-9389-5d4766b19b03', 'c5a976f5-4011-44bc-8ea4-444410395228', 'cd9cfdd5-c149-4731-ae17-ef894a9d8825', '8b9c05e3-8805-494d-90d1-523d862922eb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Delete snapshot completed successfully. Sep 06 22:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-abfff830-ee2a-4f8b-848b-44a4283e7a7f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-74441c80-9670-416e-9b2a-0f408c17bade-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-abe936fe-4b99-42e5-a9fa-a1f13e781ae7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-abe936fe-4b99-42e5-a9fa-a1f13e781ae7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e656e7-b854-4734-b171-0c2deea0cd22]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:30 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:30 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (27c14fe6-4631-4691-a12f-b63a68f70158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880fdce6-02dc-4775-a15b-a242b1f084d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880fdce6-02dc-4775-a15b-a242b1f084d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280745003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ace9dc-1c6c-4028-a661-894c2a863d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:30Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ca1b80-416e-4ab9-bad6-603f40ce6424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ca1b80-416e-4ab9-bad6-603f40ce6424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c44d0b-dea8-49a8-b2ad-121111115e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c44d0b-dea8-49a8-b2ad-121111115e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ace9dc-1c6c-4028-a661-894c2a863d98', 'volume_name': 'volume-41ace9dc-1c6c-4028-a661-894c2a863d98', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fddaf7-e612-4f8b-87c3-9e7c958b6abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fddaf7-e612-4f8b-87c3-9e7c958b6abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff82607-656d-4668-b172-de40f5b5ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume 41ace9dc-1c6c-4028-a661-894c2a863d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ace9dc-1c6c-4028-a661-894c2a863d98', 'volume_size': 1} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280745003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ace9dc-1c6c-4028-a661-894c2a863d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:30Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume 41ace9dc-1c6c-4028-a661-894c2a863d98 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:30 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:30 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 1073741824 Sep 06 22:52:30 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:30 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.743s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:30 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7 Sep 06 22:52:30 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (39913a06-a738-4b7b-9a97-0cbba21ece60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b92351d-046e-422e-ae06-ad2b00df821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b92351d-046e-422e-ae06-ad2b00df821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583931159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f671aaa4-b5eb-49b4-972c-8540d397fd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:31Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3f4086-b484-427f-b822-d21bdbbe2984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3f4086-b484-427f-b822-d21bdbbe2984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd59b0c1-9f0d-414c-94af-e5f7f8814f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd59b0c1-9f0d-414c-94af-e5f7f8814f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f671aaa4-b5eb-49b4-972c-8540d397fd64', 'volume_name': 'volume-f671aaa4-b5eb-49b4-972c-8540d397fd64', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae1d4fc-836e-4d7b-8c87-f66f94317af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae1d4fc-836e-4d7b-8c87-f66f94317af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e734f04f-d1af-4c1d-9bef-3871b9978afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume f671aaa4-b5eb-49b4-972c-8540d397fd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f671aaa4-b5eb-49b4-972c-8540d397fd64', 'volume_size': 1} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:31 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 1073741824" returned: 0 in 0.754s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:31 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" returned: 0 in 0.527s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-abe936fe-4b99-42e5-a9fa-a1f13e781ae7" released by "delete_volume" :: held 1.375s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:31 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 Sep 06 22:52:31 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (1778941b-801a-48a8-956b-89b40b8ad3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61933c85-24bd-4bf9-9406-94049012bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Created reservations ['fcbee424-1abe-4e98-884d-a72743f47a3e', '5202713e-4325-4acf-8601-0b1392a71f1d', '0f8b3690-604d-43b7-818b-9a9d5380a692', '255eb535-a959-4d18-b9eb-093df7c8e388'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61933c85-24bd-4bf9-9406-94049012bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509616473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f44d1ed-c3aa-40c4-8507-3e736a86549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:31Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6569237b-8ac8-45af-82b1-add499c2519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6569237b-8ac8-45af-82b1-add499c2519e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e7125-c209-4f82-8593-7e56d211daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e7125-c209-4f82-8593-7e56d211daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f44d1ed-c3aa-40c4-8507-3e736a86549e', 'volume_name': 'volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae29ac-0a7f-4a67-9768-7603ba1bf8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae29ac-0a7f-4a67-9768-7603ba1bf8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c143463-93d1-4a40-a45b-35a549b3d61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume 5f44d1ed-c3aa-40c4-8507-3e736a86549e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e', 'volume_size': 1} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:31 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583931159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f671aaa4-b5eb-49b4-972c-8540d397fd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:31Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume f671aaa4-b5eb-49b4-972c-8540d397fd64 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:31 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 1073741824 Sep 06 22:52:31 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff82607-656d-4668-b172-de40f5b5ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ace9dc-1c6c-4028-a661-894c2a863d98', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646a7e4d-6a6d-4386-a7a4-bf3ee0f83b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-41ace9dc-1c6c-4028-a661-894c2a863d98 (41ace9dc-1c6c-4028-a661-894c2a863d98): created successfully Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646a7e4d-6a6d-4386-a7a4-bf3ee0f83b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:31 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:31 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (27c14fe6-4631-4691-a12f-b63a68f70158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eb8db93d-68f1-41a7-b53e-024a531a42e9 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (13469c07-d9c7-49fd-a44b-9adf9d04bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60203f7-02f3-42ec-933b-d4822f6aa819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-76b38be8-b1f1-4257-b31b-dbbf102dc9b2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60203f7-02f3-42ec-933b-d4822f6aa819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1137577198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0f162-d58f-451b-95db-9dd1858410cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:32Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d7254d-0bf0-4003-84ac-2bf0ecbe1f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d7254d-0bf0-4003-84ac-2bf0ecbe1f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fa2bfa-0677-43af-b9f3-64ad8ce29570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fa2bfa-0677-43af-b9f3-64ad8ce29570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f0f162-d58f-451b-95db-9dd1858410cd', 'volume_name': 'volume-c3f0f162-d58f-451b-95db-9dd1858410cd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faba3ce-61db-4bd9-8dc3-5eabc3fa34b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faba3ce-61db-4bd9-8dc3-5eabc3fa34b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d9cfbb-e7f1-4abd-ad18-aa10e8e21c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume c3f0f162-d58f-451b-95db-9dd1858410cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f0f162-d58f-451b-95db-9dd1858410cd', 'volume_size': 1} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-76b38be8-b1f1-4257-b31b-dbbf102dc9b2-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[41055892-dd17-4eb6-8739-3e2e92ec7d7b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:32 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.861s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Deleted volume successfully. Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd1b4eec-66bd-4ce5-8c88-f3351d4f7894 tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-abe936fe-4b99-42e5-a9fa-a1f13e781ae7-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:32 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 Sep 06 22:52:32 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:32 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 1073741824" returned: 0 in 1.119s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:32 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 Sep 06 22:52:32 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:33 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (f34cb5c5-24aa-4da1-8231-46b23fdd370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480e517-6c57-40ae-a6bf-6673c4592fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" returned: 0 in 0.695s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480e517-6c57-40ae-a6bf-6673c4592fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861515399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:33Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2 Sep 06 22:52:33 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5222686-3bec-4961-b331-f52e9adf4453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5222686-3bec-4961-b331-f52e9adf4453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794c291b-434c-4f9a-a87d-11d7d9d7ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794c291b-434c-4f9a-a87d-11d7d9d7ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46', 'volume_name': 'volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44170ec4-74f2-4001-972a-60492d367176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44170ec4-74f2-4001-972a-60492d367176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c278ae38-d6f2-4476-af20-18d5847b7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46', 'volume_size': 1} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509616473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f44d1ed-c3aa-40c4-8507-3e736a86549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:31Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume 5f44d1ed-c3aa-40c4-8507-3e736a86549e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:33 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e734f04f-d1af-4c1d-9bef-3871b9978afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f671aaa4-b5eb-49b4-972c-8540d397fd64', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e 1073741824 Sep 06 22:52:33 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa46375-58f3-47ec-89c4-94f8fa34df37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 (f671aaa4-b5eb-49b4-972c-8540d397fd64): created successfully Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa46375-58f3-47ec-89c4-94f8fa34df37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (39913a06-a738-4b7b-9a97-0cbba21ece60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-829a68eb-f2fc-4eb6-865c-40a9be78fad5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:33 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-quobyte-76b38be8-b1f1-4257-b31b-dbbf102dc9b2" released by "delete_volume" :: held 1.208s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Created reservations ['031f60e3-9830-46c1-a7db-31f0dc994c32', '83894f8e-730e-44f2-a630-41af17db4544', '1a4aab37-6f89-46c7-93b7-a74eff6f27f4', 'c4b71113-e74f-4d82-827d-0410844bca8a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:33 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:33 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:33 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e 1073741824" returned: 0 in 0.626s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:34 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e Sep 06 22:52:34 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:34 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Deleted volume successfully. Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3daf0491-7e98-4b7c-ab87-e6820be6f35f tempest-SnapshotDependencyTests-1372993445 None] Lock "cinder-76b38be8-b1f1-4257-b31b-dbbf102dc9b2-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:34 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Flow 'volume_create_manager' (e398b98c-77a9-4df7-a7b1-8a5c4ce462d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb442a2b-dcb8-48ea-bfd4-520d000cbe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1137577198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0f162-d58f-451b-95db-9dd1858410cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:32Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume c3f0f162-d58f-451b-95db-9dd1858410cd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:34 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c143463-93d1-4a40-a45b-35a549b3d61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7657c77e-606b-4feb-95ed-f0143c269518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd 1073741824 Sep 06 22:52:34 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb442a2b-dcb8-48ea-bfd4-520d000cbe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-550693536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1b254f-7c62-41a9-80f2-f02b107c29b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96477a4dfaf42b58348d276a3758829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:34Z,use_quota=True,user_id='e7a68c160f014a7ca8582c6a817d19ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd332d-2083-4e12-b842-fd89dd232f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd332d-2083-4e12-b842-fd89dd232f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7d393d-9cb5-4f30-a96b-ff2e8d7406cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7d393d-9cb5-4f30-a96b-ff2e8d7406cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1b254f-7c62-41a9-80f2-f02b107c29b2', 'volume_name': 'volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e50794-948a-4e64-b0d7-d892cf25fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e50794-948a-4e64-b0d7-d892cf25fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc5364f-27a0-417a-b5f0-3d592be2cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Volume ea1b254f-7c62-41a9-80f2-f02b107c29b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2', 'volume_size': 1} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e (5f44d1ed-c3aa-40c4-8507-3e736a86549e): created successfully Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7657c77e-606b-4feb-95ed-f0143c269518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (1778941b-801a-48a8-956b-89b40b8ad3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-73301bd0-a2ec-45c8-b4d5-6517059fdef4 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:34 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd 1073741824" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:35 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd Sep 06 22:52:35 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:35 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861515399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cf49e4d60428686b1796c4263bb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:33Z,use_quota=True,user_id='313ea3d7fbe947e88ed2e5f442e36d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Creating volume fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:35 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d9cfbb-e7f1-4abd-ad18-aa10e8e21c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f0f162-d58f-451b-95db-9dd1858410cd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c950e29a-18d9-401a-b15c-9c99091f9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:35 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 1073741824 Sep 06 22:52:35 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-c3f0f162-d58f-451b-95db-9dd1858410cd (c3f0f162-d58f-451b-95db-9dd1858410cd): created successfully Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c950e29a-18d9-401a-b15c-9c99091f9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (13469c07-d9c7-49fd-a44b-9adf9d04bda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ed50c35d-c0cb-4132-b0e6-92975989511c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:35 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 1073741824" returned: 0 in 0.571s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:35 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 Sep 06 22:52:35 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:36 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-550693536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1b254f-7c62-41a9-80f2-f02b107c29b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96477a4dfaf42b58348d276a3758829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:34Z,use_quota=True,user_id='e7a68c160f014a7ca8582c6a817d19ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Creating volume ea1b254f-7c62-41a9-80f2-f02b107c29b2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c278ae38-d6f2-4476-af20-18d5847b7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b55a22-db93-4f33-9974-f1d51cc995d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:36 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 1073741824 Sep 06 22:52:36 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Volume volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 (fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46): created successfully Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b55a22-db93-4f33-9974-f1d51cc995d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Flow 'volume_create_manager' (f34cb5c5-24aa-4da1-8231-46b23fdd370f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-446a1073-7984-4eaf-a478-0afe1b2a9e38 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created volume successfully. Sep 06 22:52:36 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 1073741824" returned: 0 in 0.511s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:36 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 Sep 06 22:52:36 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fa13b-4d2e-4276-8ab4-43134ffcbc29]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:37 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 Sep 06 22:52:37 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:37 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc5364f-27a0-417a-b5f0-3d592be2cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac258a5-3c34-4ced-afa7-f810148116b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Volume volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 (ea1b254f-7c62-41a9-80f2-f02b107c29b2): created successfully Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac258a5-3c34-4ced-afa7-f810148116b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Flow 'volume_create_manager' (e398b98c-77a9-4df7-a7b1-8a5c4ce462d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f0ed9b00-bf2d-4121-9a93-6dbad6d8e5a9 tempest-VolumesServicesTestJSON-800853814 None] Created volume successfully. Sep 06 22:52:37 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:37 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46 Sep 06 22:52:37 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Acquiring lock "cinder-ea1b254f-7c62-41a9-80f2-f02b107c29b2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:37 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" returned: 0 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "cinder-ea1b254f-7c62-41a9-80f2-f02b107c29b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46" released by "delete_volume" :: held 0.873s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Acquiring lock "cinder-quobyte-ea1b254f-7c62-41a9-80f2-f02b107c29b2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "cinder-quobyte-ea1b254f-7c62-41a9-80f2-f02b107c29b2" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e22a34-1e22-4a40-b605-382ca36f441f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['ac35ca15-6e85-4e8c-89f0-1cc23c544415', '01cd5039-ac21-41bd-83e7-2155d6c1c299', 'b37dbf48-b990-467e-9622-65e60649cddf', 'ea52c6b9-b4f0-4693-8b15-fe2676b86fd5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:38 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 Sep 06 22:52:38 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:38 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:38 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-c3f0f162-d58f-451b-95db-9dd1858410cd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-c3f0f162-d58f-451b-95db-9dd1858410cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-c3f0f162-d58f-451b-95db-9dd1858410cd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-c3f0f162-d58f-451b-95db-9dd1858410cd" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1f4e0-01e9-4a44-a54b-680722246294]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:38 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:38 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd Sep 06 22:52:38 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8e0fca68-c762-4864-8a69-9ae0b026d5b5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-fd558f0d-9bc5-4dc2-b235-cc0b6e4d7a46-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:38 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2" returned: 0 in 0.596s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:38 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2 Sep 06 22:52:38 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:38 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd" returned: 0 in 0.556s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:38 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ea1b254f-7c62-41a9-80f2-f02b107c29b2" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:38 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd Sep 06 22:52:38 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "cinder-quobyte-ea1b254f-7c62-41a9-80f2-f02b107c29b2" released by "delete_volume" :: held 1.027s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Created reservations ['1c5dc161-fde7-402d-aef0-20c0f379d501', 'ab4991f0-19fc-4a8f-ac35-221b505085f3', 'd50d46e9-cfd1-4359-be99-3eeedfcdc9bf', '687dbe97-6bed-402b-81db-04b73613968a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:39 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:39 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:39 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-c3f0f162-d58f-451b-95db-9dd1858410cd" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-c3f0f162-d58f-451b-95db-9dd1858410cd" released by "delete_volume" :: held 0.931s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['ea4ed978-90fc-490b-882c-9b22736c6be7', 'c6f0c3ce-0e73-4b43-a76b-7121ffd46452', '4d243c9d-3ac5-4851-95c4-be705ba7a072', 'bd3b6ee9-d94a-44cb-b013-d09a2d68c4e2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:39 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:39 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:39 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Deleted volume successfully. Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-368d82be-8247-4b0f-b35e-272b2574abc3 tempest-VolumesServicesTestJSON-800853814 None] Lock "cinder-ea1b254f-7c62-41a9-80f2-f02b107c29b2-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:39 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba01d54b-4ff5-48ac-8eca-2774ad26fd7c tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-c3f0f162-d58f-451b-95db-9dd1858410cd-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-5f44d1ed-c3aa-40c4-8507-3e736a86549e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-5f44d1ed-c3aa-40c4-8507-3e736a86549e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-5f44d1ed-c3aa-40c4-8507-3e736a86549e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-5f44d1ed-c3aa-40c4-8507-3e736a86549e" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e358eb23-6a8f-4762-b282-4132392c893e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:40 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e Sep 06 22:52:40 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:41 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:41 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e Sep 06 22:52:41 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:41 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5f44d1ed-c3aa-40c4-8507-3e736a86549e" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-5f44d1ed-c3aa-40c4-8507-3e736a86549e" released by "delete_volume" :: held 0.751s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['baff19b5-60b2-4372-af30-e799bdc7baab', 'faea975d-277a-4534-a6ec-010b7b407fa0', 'c506f526-e0ff-4abd-99a1-580fc9588b15', 'ecec54b9-9d46-467d-90c9-5c0328239940'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:41 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:41 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-f671aaa4-b5eb-49b4-972c-8540d397fd64-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-f671aaa4-b5eb-49b4-972c-8540d397fd64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-f671aaa4-b5eb-49b4-972c-8540d397fd64" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-f671aaa4-b5eb-49b4-972c-8540d397fd64" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e7210-5cf3-49a7-ae16-49a1b022957b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:41 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b3537df-7d5b-403f-8993-b9622213f145 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-5f44d1ed-c3aa-40c4-8507-3e736a86549e-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:41 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 Sep 06 22:52:41 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:42 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:42 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64 Sep 06 22:52:42 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:42 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f671aaa4-b5eb-49b4-972c-8540d397fd64" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-f671aaa4-b5eb-49b4-972c-8540d397fd64" released by "delete_volume" :: held 0.770s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['f3210606-0e62-4fda-98fe-e4765e946c88', '7ac68450-b943-4d14-a809-34f7db548c53', '835f8908-32d2-4543-9ca2-8ae40362e096', '85032920-7fb8-46cd-9e76-212424b82c66'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:42 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:42 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-41ace9dc-1c6c-4028-a661-894c2a863d98-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-41ace9dc-1c6c-4028-a661-894c2a863d98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-41ace9dc-1c6c-4028-a661-894c2a863d98" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-41ace9dc-1c6c-4028-a661-894c2a863d98" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d067e6-fded-4747-983c-461da6b13bf3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:43 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1599411c-8bbb-4e32-8ed5-d42e02f1185a tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-f671aaa4-b5eb-49b4-972c-8540d397fd64-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:43 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 Sep 06 22:52:43 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:43 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:43 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98 Sep 06 22:52:43 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:43 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-41ace9dc-1c6c-4028-a661-894c2a863d98" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-41ace9dc-1c6c-4028-a661-894c2a863d98" released by "delete_volume" :: held 0.800s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['a92f4da7-053c-43cb-8001-3e7287369d77', 'ee05d14c-9ea5-4e23-9a47-08368c4fa121', '964a5849-d974-484d-bcdf-86513e008353', '7d476fea-fb12-44e0-8c2a-445f563ad123'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:43 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:43 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-72be583e-28b7-4264-95e0-10e909e814a2-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-72be583e-28b7-4264-95e0-10e909e814a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-72be583e-28b7-4264-95e0-10e909e814a2" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-72be583e-28b7-4264-95e0-10e909e814a2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleting offline snapshot 72be583e-28b7-4264-95e0-10e909e814a2 of volume 26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] snapshot_file for this snap is: volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc117e-4b9f-4479-a9dd-1cad04b9e94d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:44 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a136bb1-2488-467d-9f7b-38376c7c4ef6 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-41ace9dc-1c6c-4028-a661-894c2a863d98-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:44 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 Sep 06 22:52:44 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:44 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2" returned: 0 in 0.508s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b585b3-a21f-4380-9ef7-572f44e972fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[590ca2dc-8595-4906-9f24-0518563a5639]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:44 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb Sep 06 22:52:44 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:45 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:45 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 Sep 06 22:52:45 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:45 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:45 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2 Sep 06 22:52:45 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:45 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb.72be583e-28b7-4264-95e0-10e909e814a2" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-72be583e-28b7-4264-95e0-10e909e814a2" released by "_delete_snapshot" :: held 1.759s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" released by "delete_snapshot" :: held 1.807s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['a7fb0d68-6f6c-40d2-abfa-79854f7bc9e3', '0f3f6592-9488-4a40-b013-2775ead728c1', '93059353-3ee5-455a-8318-bac7b77de468', '7e164216-c0b9-4803-b682-3df2278054c2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Delete snapshot completed successfully. Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86d8dd4a-d810-49d0-9d89-d8abe999d0e5 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-72be583e-28b7-4264-95e0-10e909e814a2-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-26b585b3-a21f-4380-9ef7-572f44e972fb-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-26b585b3-a21f-4380-9ef7-572f44e972fb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7f3010-3d5a-4f04-82d3-af90e32a3331]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:46 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb Sep 06 22:52:46 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:47 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb" returned: 0 in 0.532s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:47 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb Sep 06 22:52:47 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:47 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-26b585b3-a21f-4380-9ef7-572f44e972fb" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-quobyte-26b585b3-a21f-4380-9ef7-572f44e972fb" released by "delete_volume" :: held 0.884s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Created reservations ['a22f0ed8-e995-440e-b8c3-42ee84e230e8', '7144cbfd-9cd4-4970-a91c-7d0d30b80d14', '5c829841-a724-4076-9c44-bb51f74ff8ec', '9ea644c7-239e-4746-91d9-8c74b8399d62'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:47 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:47 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:47 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Deleted volume successfully. Sep 06 22:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eebb0847-7bb9-42ac-a3ba-c9b22ac24514 tempest-CreateVolumesFromSnapshotTest-1444493613 None] Lock "cinder-26b585b3-a21f-4380-9ef7-572f44e972fb-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Flow 'volume_create_manager' (c6cdb601-723b-4c1f-9a2c-0d0b768adf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24629ab8-786b-425f-a546-fe633d980d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24629ab8-786b-425f-a546-fe633d980d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591441808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea808b-1387-47ee-a8f7-8ebbeb067a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827182902c06464f8d3c981794edfd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:54Z,use_quota=True,user_id='fcb63c24383e4250b7548ec1bebd6512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c105b3b-6236-4d3b-96f0-25c4e7b9acb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c105b3b-6236-4d3b-96f0-25c4e7b9acb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3651b6-4b38-4021-947c-149aae7cde8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3651b6-4b38-4021-947c-149aae7cde8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ea808b-1387-47ee-a8f7-8ebbeb067a9d', 'volume_name': 'volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3150e6-271f-43c7-9b49-b62d6762ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3150e6-271f-43c7-9b49-b62d6762ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd424c76-8427-414e-a64b-f83b2232e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Volume 03ea808b-1387-47ee-a8f7-8ebbeb067a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d', 'volume_size': 1} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591441808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea808b-1387-47ee-a8f7-8ebbeb067a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827182902c06464f8d3c981794edfd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:54Z,use_quota=True,user_id='fcb63c24383e4250b7548ec1bebd6512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Creating volume 03ea808b-1387-47ee-a8f7-8ebbeb067a9d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:53 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:53 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d 1073741824 Sep 06 22:52:53 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Flow 'volume_create_manager' (770593db-d370-4ee0-8c15-3125c143e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc208fbb-f1a9-447f-840d-9c024fbf2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc208fbb-f1a9-447f-840d-9c024fbf2277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-347358416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99484195-09f3-4f21-92f8-8167121462b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd39a2793fe74d08b9258c175a9a3259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:54Z,use_quota=True,user_id='dd2e1e78e3594a398abae967dbda2b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3fa3e80-2b31-461e-a843-81bbe1521bf0),volume_type_id=a3fa3e80-2b31-461e-a843-81bbe1521bf0)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2253ab42-994d-4b87-a883-de73b3d88923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2253ab42-994d-4b87-a883-de73b3d88923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c23ccdd-a66f-4a6b-a961-7782d84cb6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c23ccdd-a66f-4a6b-a961-7782d84cb6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99484195-09f3-4f21-92f8-8167121462b1', 'volume_name': 'volume-99484195-09f3-4f21-92f8-8167121462b1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc917a8c-a659-4b3b-bbc1-cdd9d7c5f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc917a8c-a659-4b3b-bbc1-cdd9d7c5f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454eeffc-59c6-418a-8162-4758140afacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Volume 99484195-09f3-4f21-92f8-8167121462b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99484195-09f3-4f21-92f8-8167121462b1', 'volume_size': 1} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d 1073741824" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:54 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d Sep 06 22:52:54 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:54 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-347358416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99484195-09f3-4f21-92f8-8167121462b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd39a2793fe74d08b9258c175a9a3259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:54Z,use_quota=True,user_id='dd2e1e78e3594a398abae967dbda2b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3fa3e80-2b31-461e-a843-81bbe1521bf0),volume_type_id=a3fa3e80-2b31-461e-a843-81bbe1521bf0)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Creating volume 99484195-09f3-4f21-92f8-8167121462b1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:54 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd424c76-8427-414e-a64b-f83b2232e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 1073741824 Sep 06 22:52:54 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905a4c0b-fb76-4db2-8820-7041c4108754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Volume volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d (03ea808b-1387-47ee-a8f7-8ebbeb067a9d): created successfully Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905a4c0b-fb76-4db2-8820-7041c4108754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Flow 'volume_create_manager' (c6cdb601-723b-4c1f-9a2c-0d0b768adf39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8614bf6f-4ce1-43ed-8338-bb3307a7c70a tempest-ProjectReaderTests-1178644223 None] Created volume successfully. Sep 06 22:52:55 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 1073741824" returned: 0 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:55 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 Sep 06 22:52:55 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:55 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454eeffc-59c6-418a-8162-4758140afacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99484195-09f3-4f21-92f8-8167121462b1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494c159a-1a3f-4a9c-9ef9-b4b6abf9b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Volume volume-99484195-09f3-4f21-92f8-8167121462b1 (99484195-09f3-4f21-92f8-8167121462b1): created successfully Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494c159a-1a3f-4a9c-9ef9-b4b6abf9b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Flow 'volume_create_manager' (770593db-d370-4ee0-8c15-3125c143e89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-71a48db8-50a7-4515-8df0-f79006a985a0 tempest-VolumeTypesAccessTest-159028393 None] Created volume successfully. Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Acquiring lock "cinder-03ea808b-1387-47ee-a8f7-8ebbeb067a9d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "cinder-03ea808b-1387-47ee-a8f7-8ebbeb067a9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Acquiring lock "cinder-quobyte-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "cinder-quobyte-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[722a1dbb-5ee9-4795-a622-30388bc9fe49]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:56 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d Sep 06 22:52:56 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Acquiring lock "cinder-99484195-09f3-4f21-92f8-8167121462b1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "cinder-99484195-09f3-4f21-92f8-8167121462b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Acquiring lock "cinder-quobyte-99484195-09f3-4f21-92f8-8167121462b1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "cinder-quobyte-99484195-09f3-4f21-92f8-8167121462b1" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ff431-1eec-4b9f-b1e7-4c2af8d4ae05]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:56 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:56 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d Sep 06 22:52:56 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:56 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 Sep 06 22:52:56 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:56 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "cinder-quobyte-03ea808b-1387-47ee-a8f7-8ebbeb067a9d" released by "delete_volume" :: held 0.722s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Created reservations ['f90ee9eb-eb94-454d-9156-e47c402903d3', '28ad4ed3-5023-4d6f-a9eb-3c58f7fe5404', 'fcb72da6-9e1d-445d-9651-3a5c1f401eca', '68a1795e-3be9-47ff-bde7-14a4e56ee513'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:56 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:56 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1 Sep 06 22:52:56 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:56 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:56 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:57 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99484195-09f3-4f21-92f8-8167121462b1" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "cinder-quobyte-99484195-09f3-4f21-92f8-8167121462b1" released by "delete_volume" :: held 0.741s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:57 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Deleted volume successfully. Sep 06 22:52:57 devstack cinder-volume[87517]: WARNING cinder.quota [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1445702374 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1445702374, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:52:57 devstack cinder-volume[87517]: WARNING cinder.quota [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1445702374 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1445702374, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Created reservations ['a7bbcc79-546b-45ea-b767-d79560b7e863', '7b2b0b40-c97e-4771-9492-e4d0470840ea', 'f4c35df0-7f76-4a78-9aa7-d2a5ff2764d7', 'faf0bc39-bb4a-48a2-8456-ac3834a67d60'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b1073d54-cf0d-44e0-9269-35dbb21ac223 tempest-ProjectReaderTests-1178644223 None] Lock "cinder-03ea808b-1387-47ee-a8f7-8ebbeb067a9d-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:57 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:52:57 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:57 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Flow 'volume_create_manager' (1cfd4023-8b95-4992-b719-54ff7288c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3277737b-7286-45c0-bce7-19bfb979a6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Deleted volume successfully. Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3277737b-7286-45c0-bce7-19bfb979a6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864949983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09b1fb-af49-40db-9d23-4b45e3423315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827182902c06464f8d3c981794edfd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:58Z,use_quota=True,user_id='fcb63c24383e4250b7548ec1bebd6512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c73ced-8059-41fc-9077-19dd793a5e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c73ced-8059-41fc-9077-19dd793a5e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e55606-2887-4688-a380-9e1cfdbc6540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e55606-2887-4688-a380-9e1cfdbc6540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c09b1fb-af49-40db-9d23-4b45e3423315', 'volume_name': 'volume-4c09b1fb-af49-40db-9d23-4b45e3423315', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034cb436-6b3e-4eb5-a31c-05660a84396a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034cb436-6b3e-4eb5-a31c-05660a84396a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136e210e-75eb-476e-bc8a-9b47a67821dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Volume 4c09b1fb-af49-40db-9d23-4b45e3423315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c09b1fb-af49-40db-9d23-4b45e3423315', 'volume_size': 1} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864949983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09b1fb-af49-40db-9d23-4b45e3423315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827182902c06464f8d3c981794edfd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:52:58Z,use_quota=True,user_id='fcb63c24383e4250b7548ec1bebd6512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Creating volume 4c09b1fb-af49-40db-9d23-4b45e3423315 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:52:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea79dd8a-c5c2-4cde-ad95-23d3404a898a tempest-VolumeTypesAccessTest-159028393 None] Lock "cinder-99484195-09f3-4f21-92f8-8167121462b1-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:52:57 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 1073741824 Sep 06 22:52:57 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:58 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 1073741824" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:52:58 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 Sep 06 22:52:58 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:52:58 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136e210e-75eb-476e-bc8a-9b47a67821dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c09b1fb-af49-40db-9d23-4b45e3423315', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de70c74b-96cc-4d5b-a2b8-e1bcc8a7cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:52:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Volume volume-4c09b1fb-af49-40db-9d23-4b45e3423315 (4c09b1fb-af49-40db-9d23-4b45e3423315): created successfully Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de70c74b-96cc-4d5b-a2b8-e1bcc8a7cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Flow 'volume_create_manager' (1cfd4023-8b95-4992-b719-54ff7288c99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:52:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-53cf43ce-886c-4b50-a2d4-67838f5db9a5 tempest-ProjectReaderTests-1178644223 None] Created volume successfully. Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Acquiring lock "cinder-4c09b1fb-af49-40db-9d23-4b45e3423315-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "cinder-4c09b1fb-af49-40db-9d23-4b45e3423315-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Acquiring lock "cinder-quobyte-4c09b1fb-af49-40db-9d23-4b45e3423315" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "cinder-quobyte-4c09b1fb-af49-40db-9d23-4b45e3423315" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7179d1e-d7ba-47c5-9afd-0e1bf25f3c4c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:00 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 Sep 06 22:53:00 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:00 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315" returned: 0 in 0.486s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:00 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315 Sep 06 22:53:00 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:00 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4c09b1fb-af49-40db-9d23-4b45e3423315" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "cinder-quobyte-4c09b1fb-af49-40db-9d23-4b45e3423315" released by "delete_volume" :: held 0.869s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Created reservations ['21e21dd1-1ff9-4c5c-8644-c3351e470950', '020d2346-3ef5-4a4d-b8c1-cd4774fe3328', '2a4e629f-ef88-48f4-a801-764029cc83b5', '39e8e848-1873-4006-a0bc-b7ceb4576eac'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:00 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:00 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:01 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Deleted volume successfully. Sep 06 22:53:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-56b02735-120c-46c0-99a7-7bafef32441b tempest-ProjectReaderTests-1178644223 None] Lock "cinder-4c09b1fb-af49-40db-9d23-4b45e3423315-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:05 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:05 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:06 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.474s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:53:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:53:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:53:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=168,cinder:SELECT=125,cinder:DELETE=19,cinder:INSERT=38 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:53:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=117,cinder:DELETE=12,cinder:INSERT=48,cinder:UPDATE=186 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Flow 'volume_create_manager' (a9bd64f0-8a72-4b44-964c-654a2fa3d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c8813f-d606-4a49-be1f-c34dee26d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c8813f-d606-4a49-be1f-c34dee26d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-911527535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e23b2-9b9a-42ed-a471-679fb25b46cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241def44ae934d3fb8fb92b90f55acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:19Z,use_quota=True,user_id='13f471104e9c47e4a1284b82532a997c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1474d92-0d79-4061-ad99-f28f4de9f825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1474d92-0d79-4061-ad99-f28f4de9f825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77601144-0725-4a64-bc6f-ab8fa962fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77601144-0725-4a64-bc6f-ab8fa962fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36e23b2-9b9a-42ed-a471-679fb25b46cf', 'volume_name': 'volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53e7ac8-a66d-4f4b-ad73-8922d268dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53e7ac8-a66d-4f4b-ad73-8922d268dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20e0bf-aae1-4eb5-b1b1-9a4dd7f6eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Volume d36e23b2-9b9a-42ed-a471-679fb25b46cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf', 'volume_size': 1} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-911527535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e23b2-9b9a-42ed-a471-679fb25b46cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241def44ae934d3fb8fb92b90f55acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:19Z,use_quota=True,user_id='13f471104e9c47e4a1284b82532a997c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Creating volume d36e23b2-9b9a-42ed-a471-679fb25b46cf {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:19 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:19 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf 1073741824 Sep 06 22:53:19 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:19 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf 1073741824" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:19 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf Sep 06 22:53:19 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:19 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20e0bf-aae1-4eb5-b1b1-9a4dd7f6eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c916561-ff76-4627-9a47-76c6f4628935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Volume volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf (d36e23b2-9b9a-42ed-a471-679fb25b46cf): created successfully Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c916561-ff76-4627-9a47-76c6f4628935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Flow 'volume_create_manager' (a9bd64f0-8a72-4b44-964c-654a2fa3d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0ddf0ccc-c5e8-441f-bd96-3c7175c88f95 tempest-VolumesTransfersV355Test-666332327 None] Created volume successfully. Sep 06 22:53:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f90b111a-29ad-4d33-987b-27bc452f3715 tempest-VolumesTransfersV355Test-788381635 None] Transfer volume completed successfully. Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "cinder-d36e23b2-9b9a-42ed-a471-679fb25b46cf-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-d36e23b2-9b9a-42ed-a471-679fb25b46cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "cinder-quobyte-d36e23b2-9b9a-42ed-a471-679fb25b46cf" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-quobyte-d36e23b2-9b9a-42ed-a471-679fb25b46cf" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c028c13-46c8-4386-b879-3d006d1ef2fd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:21 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf Sep 06 22:53:21 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:21 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:21 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf Sep 06 22:53:21 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:21 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d36e23b2-9b9a-42ed-a471-679fb25b46cf" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-quobyte-d36e23b2-9b9a-42ed-a471-679fb25b46cf" released by "delete_volume" :: held 0.638s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Created reservations ['63a69366-f221-4680-8cbd-0edafe9ac678', '7e90dc68-089f-445b-bfc0-263822e20b66', 'eb2d4c3e-b56f-4b24-8d8d-395dfe0e894c', '666ac805-12ca-469c-ab0d-6af3759b4d0a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:22 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:22 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:22 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Deleted volume successfully. Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b47a64e9-d3af-4fa8-833a-9b9649652066 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-d36e23b2-9b9a-42ed-a471-679fb25b46cf-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Flow 'volume_create_manager' (2e353126-948c-4cb8-b03f-453d0013ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8cb1b-62fa-4ed7-93a7-b6dde230b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8cb1b-62fa-4ed7-93a7-b6dde230b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-130646806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0557d0-6545-4d28-b6a3-2d2b9c94245b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241def44ae934d3fb8fb92b90f55acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:23Z,use_quota=True,user_id='13f471104e9c47e4a1284b82532a997c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3936c8-d78d-42aa-bea1-4cd0eb8ba280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3936c8-d78d-42aa-bea1-4cd0eb8ba280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13eaa6c2-054d-4664-8f7b-0f047fd0549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13eaa6c2-054d-4664-8f7b-0f047fd0549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0557d0-6545-4d28-b6a3-2d2b9c94245b', 'volume_name': 'volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadee742-2214-463f-bd1f-5539469d8086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadee742-2214-463f-bd1f-5539469d8086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675575d2-bad9-430d-bf76-04b7791c35e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Volume 3c0557d0-6545-4d28-b6a3-2d2b9c94245b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b', 'volume_size': 1} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-130646806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0557d0-6545-4d28-b6a3-2d2b9c94245b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241def44ae934d3fb8fb92b90f55acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:23Z,use_quota=True,user_id='13f471104e9c47e4a1284b82532a997c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Creating volume 3c0557d0-6545-4d28-b6a3-2d2b9c94245b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:22 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:22 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b 1073741824 Sep 06 22:53:22 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:23 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b 1073741824" returned: 0 in 0.389s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:23 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b Sep 06 22:53:23 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:23 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675575d2-bad9-430d-bf76-04b7791c35e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f944f3-e8bd-4216-a87d-6a6c1318bb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Volume volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b (3c0557d0-6545-4d28-b6a3-2d2b9c94245b): created successfully Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f944f3-e8bd-4216-a87d-6a6c1318bb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Flow 'volume_create_manager' (2e353126-948c-4cb8-b03f-453d0013ba08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3c41be65-4f99-408c-9a07-b1cb3cf54d3b tempest-VolumesTransfersV355Test-666332327 None] Created volume successfully. Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "cinder-3c0557d0-6545-4d28-b6a3-2d2b9c94245b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-3c0557d0-6545-4d28-b6a3-2d2b9c94245b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "cinder-quobyte-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-quobyte-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ce3dc5-4b11-40a5-89b3-dbd89fc652b0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:24 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b Sep 06 22:53:24 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:24 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:24 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b Sep 06 22:53:24 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:24 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-quobyte-3c0557d0-6545-4d28-b6a3-2d2b9c94245b" released by "delete_volume" :: held 0.627s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Created reservations ['804d8b5b-96cd-4a88-b94f-a907944041bf', 'adbab3cb-21a6-4518-b829-c1c2cab9774f', '8540b640-3157-4852-a22f-8bcab738b9c1', 'b1d0fd29-153b-48d3-8026-0a2ffd39b57f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:24 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:24 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:25 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.239s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Deleted volume successfully. Sep 06 22:53:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-838cdb7c-daa8-4356-b1af-3379069af941 tempest-VolumesTransfersV355Test-10834597 None] Lock "cinder-3c0557d0-6545-4d28-b6a3-2d2b9c94245b-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (d639782a-7b9c-4896-b51c-b562d5fdc2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ad8f63-e945-4377-af95-98e1e951e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ad8f63-e945-4377-af95-98e1e951e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-178744381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8806519d-b4f2-4bc7-afa3-7673bf6eaa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:30Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a91f7a7-16fb-4477-8f47-c995c4ee4e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a91f7a7-16fb-4477-8f47-c995c4ee4e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc87d70-ee24-49e8-bd6a-dca566a8e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc87d70-ee24-49e8-bd6a-dca566a8e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8806519d-b4f2-4bc7-afa3-7673bf6eaa61', 'volume_name': 'volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa77f317-560b-4de5-9b73-ffa79d8f2c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa77f317-560b-4de5-9b73-ffa79d8f2c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07091742-d9cf-437d-ad77-3c2f0e6895af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Volume 8806519d-b4f2-4bc7-afa3-7673bf6eaa61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61', 'volume_size': 1} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-178744381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8806519d-b4f2-4bc7-afa3-7673bf6eaa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:30Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Creating volume 8806519d-b4f2-4bc7-afa3-7673bf6eaa61 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:29 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 1073741824 Sep 06 22:53:29 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:30 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 1073741824" returned: 0 in 0.450s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:30 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 Sep 06 22:53:30 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:30 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07091742-d9cf-437d-ad77-3c2f0e6895af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d7d03a-eac1-4d1f-a2cf-2fe5ec37e948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Volume volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 (8806519d-b4f2-4bc7-afa3-7673bf6eaa61): created successfully Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d7d03a-eac1-4d1f-a2cf-2fe5ec37e948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (d639782a-7b9c-4896-b51c-b562d5fdc2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-132c062f-3298-4d53-9f24-39478172570b tempest-AttachVolumeTestJSON-646915831 None] Created volume successfully. Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Flow 'volume_create_manager' (93df6e43-a9a2-4e77-a551-19350ad7c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9af6ef-75ef-4e05-8973-675f3b3c1d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9af6ef-75ef-4e05-8973-675f3b3c1d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1650636161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd845927-72d9-4b58-87cf-fb5af11b2f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5933d2b4aa5244aeb04fefa1473ad4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:31Z,use_quota=True,user_id='4cb27dd5e858463994ff76e3b60c8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d22698b-5490-43cb-9323-d185f2aa338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d22698b-5490-43cb-9323-d185f2aa338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175d5bbe-096a-430d-9f45-ab332281a53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175d5bbe-096a-430d-9f45-ab332281a53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd845927-72d9-4b58-87cf-fb5af11b2f6c', 'volume_name': 'volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65895496-3bcc-4251-a692-1eed9cece365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65895496-3bcc-4251-a692-1eed9cece365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5924a276-d1df-40a9-a7d6-fbd167a62258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Volume cd845927-72d9-4b58-87cf-fb5af11b2f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c', 'volume_size': 2} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1650636161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd845927-72d9-4b58-87cf-fb5af11b2f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5933d2b4aa5244aeb04fefa1473ad4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:31Z,use_quota=True,user_id='4cb27dd5e858463994ff76e3b60c8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Creating volume cd845927-72d9-4b58-87cf-fb5af11b2f6c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c 2147483648 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:31 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c 2147483648 Sep 06 22:53:31 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d571a877-d0b8-472d-bc62-96479401e590 req-78ba92da-d796-42dc-b3d5-1efe93c24d03 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:31 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c 2147483648" returned: 0 in 0.449s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:31 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c Sep 06 22:53:31 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:32 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d571a877-d0b8-472d-bc62-96479401e590 req-78ba92da-d796-42dc-b3d5-1efe93c24d03 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.623s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5924a276-d1df-40a9-a7d6-fbd167a62258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6510832d-5681-44bb-a1df-5ce90daa79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d571a877-d0b8-472d-bc62-96479401e590 req-78ba92da-d796-42dc-b3d5-1efe93c24d03 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Volume volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c (cd845927-72d9-4b58-87cf-fb5af11b2f6c): created successfully Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6510832d-5681-44bb-a1df-5ce90daa79d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Flow 'volume_create_manager' (93df6e43-a9a2-4e77-a551-19350ad7c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7f15e23f-3f1f-4508-a81b-9be5218be7b0 tempest-VolumesCloneNegativeTest-1964660016 None] Created volume successfully. Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d571a877-d0b8-472d-bc62-96479401e590 req-78ba92da-d796-42dc-b3d5-1efe93c24d03 tempest-AttachVolumeTestJSON-646915831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99eb817a-a526-430c-9751-337c5246e921', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:53:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d571a877-d0b8-472d-bc62-96479401e590 req-78ba92da-d796-42dc-b3d5-1efe93c24d03 tempest-AttachVolumeTestJSON-646915831 None] attachment_update completed successfully. Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Acquiring lock "cinder-cd845927-72d9-4b58-87cf-fb5af11b2f6c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "cinder-cd845927-72d9-4b58-87cf-fb5af11b2f6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Acquiring lock "cinder-quobyte-cd845927-72d9-4b58-87cf-fb5af11b2f6c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "cinder-quobyte-cd845927-72d9-4b58-87cf-fb5af11b2f6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d75b5f-dcfa-4ab7-a817-3220e913f532]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:32 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c Sep 06 22:53:32 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:33 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:33 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c Sep 06 22:53:33 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:33 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd845927-72d9-4b58-87cf-fb5af11b2f6c" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "cinder-quobyte-cd845927-72d9-4b58-87cf-fb5af11b2f6c" released by "delete_volume" :: held 0.716s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Created reservations ['f58ade0f-ab2a-4918-a320-26752205055c', 'eb447ddb-5997-4bb8-a6da-5efd2f9f2e50', '2ed63911-0f62-4efb-902a-357329080fa9', 'd3ebf062-8e16-4ddf-816b-116d8bd5de68'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:33 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:33 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:33 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Deleted volume successfully. Sep 06 22:53:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-156e6061-bafb-4512-9348-2fd34c6ef5f5 tempest-VolumesCloneNegativeTest-1964660016 None] Lock "cinder-cd845927-72d9-4b58-87cf-fb5af11b2f6c-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (2795cc67-a6bc-4fe7-9c7c-9571d0ff9161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a038fa4-b8ff-4b7c-85f3-16ab700e60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a038fa4-b8ff-4b7c-85f3-16ab700e60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1840249646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d019b82c-50a4-4461-bf38-528c0e7e7a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:34Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb4f0b-cb74-4324-a309-b1210f966c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb4f0b-cb74-4324-a309-b1210f966c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912d40e0-8238-4b7a-9fb2-b5c6a44baee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912d40e0-8238-4b7a-9fb2-b5c6a44baee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd019b82c-50a4-4461-bf38-528c0e7e7a14', 'volume_name': 'volume-d019b82c-50a4-4461-bf38-528c0e7e7a14', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b7a58-5636-4ca4-88dd-cb58873bdbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273b7a58-5636-4ca4-88dd-cb58873bdbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7875b579-fbef-48de-9e0c-bef9ad130fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Volume d019b82c-50a4-4461-bf38-528c0e7e7a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d019b82c-50a4-4461-bf38-528c0e7e7a14', 'volume_size': 1} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1840249646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d019b82c-50a4-4461-bf38-528c0e7e7a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab0d16bbe2f4b729f86ca65a4d323eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:34Z,use_quota=True,user_id='a7526b2d90fb478eb33d8bcf4599cae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Creating volume d019b82c-50a4-4461-bf38-528c0e7e7a14 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:34 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:34 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 1073741824 Sep 06 22:53:34 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:34 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 1073741824" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:34 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 Sep 06 22:53:34 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:35 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7875b579-fbef-48de-9e0c-bef9ad130fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d019b82c-50a4-4461-bf38-528c0e7e7a14', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7700c6-af43-4385-9671-223ce3b56898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Volume volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 (d019b82c-50a4-4461-bf38-528c0e7e7a14): created successfully Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7700c6-af43-4385-9671-223ce3b56898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Flow 'volume_create_manager' (2795cc67-a6bc-4fe7-9c7c-9571d0ff9161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f778cb10-1d7c-444a-83ab-b189cf701b77 tempest-AttachVolumeTestJSON-646915831 None] Created volume successfully. Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dc01ba8d-2dc0-458e-9c16-0e1c48cf172f req-e5ff410d-2248-4353-9cdc-e079b11cb7c8 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dc01ba8d-2dc0-458e-9c16-0e1c48cf172f req-e5ff410d-2248-4353-9cdc-e079b11cb7c8 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dc01ba8d-2dc0-458e-9c16-0e1c48cf172f req-e5ff410d-2248-4353-9cdc-e079b11cb7c8 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-dc01ba8d-2dc0-458e-9c16-0e1c48cf172f req-e5ff410d-2248-4353-9cdc-e079b11cb7c8 tempest-AttachVolumeTestJSON-646915831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-d019b82c-50a4-4461-bf38-528c0e7e7a14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd200e9b5-61a1-473c-bcdc-98dbfcf14c15', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:53:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-dc01ba8d-2dc0-458e-9c16-0e1c48cf172f req-e5ff410d-2248-4353-9cdc-e079b11cb7c8 tempest-AttachVolumeTestJSON-646915831 None] attachment_update completed successfully. Sep 06 22:53:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ca0fe409-f7ec-4974-bf69-88f67202ba2d req-a5fadc26-4f3c-4aea-9a69-a43abf369025 tempest-AttachVolumeTestJSON-646915831 None] Terminate volume connection completed successfully. Sep 06 22:53:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ca0fe409-f7ec-4974-bf69-88f67202ba2d req-a5fadc26-4f3c-4aea-9a69-a43abf369025 tempest-AttachVolumeTestJSON-646915831 None] Deleting attachment 99eb817a-a526-430c-9751-337c5246e921. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:53:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d0418f99-c4c1-4872-8ad6-65dbd807b7a4 req-8c2d3688-f96d-4127-8248-f1f085d27cff tempest-AttachVolumeTestJSON-646915831 None] Terminate volume connection completed successfully. Sep 06 22:53:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d0418f99-c4c1-4872-8ad6-65dbd807b7a4 req-8c2d3688-f96d-4127-8248-f1f085d27cff tempest-AttachVolumeTestJSON-646915831 None] Deleting attachment d200e9b5-61a1-473c-bcdc-98dbfcf14c15. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-d019b82c-50a4-4461-bf38-528c0e7e7a14-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-d019b82c-50a4-4461-bf38-528c0e7e7a14-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-quobyte-d019b82c-50a4-4461-bf38-528c0e7e7a14" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-d019b82c-50a4-4461-bf38-528c0e7e7a14" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9850093f-1be4-4160-93f8-f7b52bc67e76]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:44 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 Sep 06 22:53:44 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:45 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:45 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14 Sep 06 22:53:45 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:45 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d019b82c-50a4-4461-bf38-528c0e7e7a14" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-d019b82c-50a4-4461-bf38-528c0e7e7a14" released by "delete_volume" :: held 0.696s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Created reservations ['667cd1dc-1131-464e-89c0-a313c1167138', '85df6829-04d6-437f-9aeb-8e5358862f71', '6deef173-d15e-430a-b3b6-e6eadc9b3fa3', '37bd2cac-811a-4d02-b948-d7a03ac2aced'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:45 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:45 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:45 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Deleted volume successfully. Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9f41f88-6797-48d3-be41-9bec41c28811 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-d019b82c-50a4-4461-bf38-528c0e7e7a14-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-8806519d-b4f2-4bc7-afa3-7673bf6eaa61-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-8806519d-b4f2-4bc7-afa3-7673bf6eaa61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-quobyte-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7a88d-dd3a-4932-99af-2559c64ddd75]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:45 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 Sep 06 22:53:45 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:46 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:46 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61 Sep 06 22:53:46 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:46 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-8806519d-b4f2-4bc7-afa3-7673bf6eaa61" released by "delete_volume" :: held 0.680s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Created reservations ['39508b2c-4f96-49b9-8fc2-7eec0a41c022', 'c9553201-967d-4537-9964-f76c7ed350f9', '571882f0-b3f8-4bef-8389-2c654739ace7', '0bf68c23-7854-45fa-9e48-da60152f25d7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:46 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:46 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:46 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Deleted volume successfully. Sep 06 22:53:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d457e952-6c71-4240-bd19-f865a8025330 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-8806519d-b4f2-4bc7-afa3-7673bf6eaa61-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-829e7194-85f0-4a51-a860-42571155c84f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-829e7194-85f0-4a51-a860-42571155c84f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "cinder-quobyte-829e7194-85f0-4a51-a860-42571155c84f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-829e7194-85f0-4a51-a860-42571155c84f" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fdbbac-cc3b-427a-9452-830ff43a6a72]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:47 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f Sep 06 22:53:47 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:47 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:47 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f Sep 06 22:53:47 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:47 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-829e7194-85f0-4a51-a860-42571155c84f" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-quobyte-829e7194-85f0-4a51-a860-42571155c84f" released by "delete_volume" :: held 0.679s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Created reservations ['e962a370-5d21-4bb8-9435-b8739ca29577', 'f0c28195-7e2d-407d-8f69-60c323ce37ab', 'fe9fee31-3b09-4a19-8a59-be4a6f3af7a1', '3b4f1cf7-c010-4cd9-bdaf-47ab246bd231'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:47 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:53:47 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:48 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:48 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:53:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Deleted volume successfully. Sep 06 22:53:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-85cbf377-560c-41f6-82d6-310b6ae23bd5 tempest-AttachVolumeTestJSON-646915831 None] Lock "cinder-829e7194-85f0-4a51-a860-42571155c84f-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Flow 'volume_create_manager' (e51265fb-81e9-4dca-ba0b-adeeecbe99f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c883cfe4-b1d1-4371-aee8-b395e7effa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c883cfe4-b1d1-4371-aee8-b395e7effa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1714061939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01338242-19dc-4c2a-89ef-e7be76dc9726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ca350da0f64a4b93039fa6327ddeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:56Z,use_quota=True,user_id='ecc866764c174418bb586b6bcbc3ee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1923b508-9a10-4119-b076-b22df5af75d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1923b508-9a10-4119-b076-b22df5af75d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cdad31-542d-46c3-93a0-a81069c90ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cdad31-542d-46c3-93a0-a81069c90ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01338242-19dc-4c2a-89ef-e7be76dc9726', 'volume_name': 'volume-01338242-19dc-4c2a-89ef-e7be76dc9726', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2a2446-804e-43dd-a2b1-a39f4427b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2a2446-804e-43dd-a2b1-a39f4427b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da65bfa7-9cf8-4e4c-873c-8f0be89b2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Volume 01338242-19dc-4c2a-89ef-e7be76dc9726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01338242-19dc-4c2a-89ef-e7be76dc9726', 'volume_size': 1} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1714061939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01338242-19dc-4c2a-89ef-e7be76dc9726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ca350da0f64a4b93039fa6327ddeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:53:56Z,use_quota=True,user_id='ecc866764c174418bb586b6bcbc3ee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Creating volume 01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:53:56 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:56 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 1073741824 Sep 06 22:53:56 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:56 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 1073741824" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:57 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 Sep 06 22:53:57 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:57 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da65bfa7-9cf8-4e4c-873c-8f0be89b2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01338242-19dc-4c2a-89ef-e7be76dc9726', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9b49df-42d9-43f1-bcbb-8e5400ac4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:53:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Volume volume-01338242-19dc-4c2a-89ef-e7be76dc9726 (01338242-19dc-4c2a-89ef-e7be76dc9726): created successfully Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9b49df-42d9-43f1-bcbb-8e5400ac4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Flow 'volume_create_manager' (e51265fb-81e9-4dca-ba0b-adeeecbe99f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:53:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ab9e78ce-30e9-4bf8-a6aa-b77e1aca6069 req-8c5de850-f324-427e-9ab8-867605f3f3c7 tempest-VolumesSnapshotsTestJSON-556105562 None] Created volume successfully. Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Creating offline snapshot 47231c76-9324-4b34-a09f-9c32dcdafe76 of volume 01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7b8db-bc41-4ebd-87d9-45528edc3240]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:53:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:58 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 Sep 06 22:53:58 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:58 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:58 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 1G Sep 06 22:53:58 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:58 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 1G" returned: 0 in 0.482s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01338242-19dc-4c2a-89ef-e7be76dc9726 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:58 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01338242-19dc-4c2a-89ef-e7be76dc9726 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 Sep 06 22:53:58 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:59 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01338242-19dc-4c2a-89ef-e7be76dc9726 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 is being set with open permissions: ugo+rw Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:59 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 Sep 06 22:53:59 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:59 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:59 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info Sep 06 22:53:59 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:59 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info is being set with open permissions: ugo+rw Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:53:59 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info Sep 06 22:53:59 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:53:59 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.info" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:53:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:53:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-358e3f5d-a1de-4d62-a067-286ae09d27d9 req-dd7ef96e-4ee7-4918-bb2f-35b57855776e tempest-VolumesSnapshotsTestJSON-556105562 None] Create snapshot completed successfully Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "cinder-47231c76-9324-4b34-a09f-9c32dcdafe76-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-47231c76-9324-4b34-a09f-9c32dcdafe76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "cinder-quobyte-47231c76-9324-4b34-a09f-9c32dcdafe76" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-47231c76-9324-4b34-a09f-9c32dcdafe76" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Deleting offline snapshot 47231c76-9324-4b34-a09f-9c32dcdafe76 of volume 01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] snapshot_file for this snap is: volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[10305542-1528-4139-b33e-dd1466fc7f08]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:00 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 Sep 06 22:54:00 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:00 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01338242-19dc-4c2a-89ef-e7be76dc9726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6ea875-b106-4f52-9d49-27a868ece18b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:00 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 Sep 06 22:54:00 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:01 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:01 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 Sep 06 22:54:01 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:01 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:01 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76 Sep 06 22:54:01 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:01 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726.47231c76-9324-4b34-a09f-9c32dcdafe76" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-47231c76-9324-4b34-a09f-9c32dcdafe76" released by "_delete_snapshot" :: held 1.592s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" released by "delete_snapshot" :: held 1.627s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.quota [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Created reservations ['f0a932a2-491e-44a1-8683-e1967278f655', '1d5f1989-5981-43c9-b241-53255ffd057b', 'bbf032d1-300d-4604-be00-bb4b8bb678c3', 'c7853e44-efe2-41e8-aee9-328c26b95ab6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Delete snapshot completed successfully. Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0674d27b-c82f-4eff-8962-f30b355e7ff5 req-31556789-1534-46d0-88da-4403553aec78 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-47231c76-9324-4b34-a09f-9c32dcdafe76-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "cinder-01338242-19dc-4c2a-89ef-e7be76dc9726-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-01338242-19dc-4c2a-89ef-e7be76dc9726-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bebe5bf-ffca-4588-850e-5184106fcbfb]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:02 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 Sep 06 22:54:02 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:03 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726" returned: 0 in 0.520s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:03 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726 Sep 06 22:54:03 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:03 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-01338242-19dc-4c2a-89ef-e7be76dc9726" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-quobyte-01338242-19dc-4c2a-89ef-e7be76dc9726" released by "delete_volume" :: held 0.998s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG cinder.quota [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Created reservations ['575df694-4cf9-4f9e-b2e6-4aca6a3de26f', 'a3bee111-cbc3-44c2-a6a1-d0b1f22c47c7', '4c025df6-90d6-4ef5-865c-536f447e62e4', 'f10b1e68-a77f-4e2f-82ec-9d877eee0a24'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:03 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:03 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:04 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:04 devstack cinder-volume[87517]: DEBUG cinder.manager [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Deleted volume successfully. Sep 06 22:54:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-ab860fda-f19a-4982-b9e1-d3e57f489ad1 req-91bf5f7b-fb58-4f47-a574-c316750b0ea2 tempest-VolumesSnapshotsTestJSON-556105562 None] Lock "cinder-01338242-19dc-4c2a-89ef-e7be76dc9726-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:05 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:05 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:06 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.435s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:54:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:54:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Flow 'volume_create_manager' (56cd5137-f06a-4ce4-be84-c70b7e677d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572eb17a-2774-4973-9618-b64940ddf199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572eb17a-2774-4973-9618-b64940ddf199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-718514539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d0ca1-e462-4f27-a1e2-dd9167b403bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895335a9cf6045158cf4e5b537b310af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:10Z,use_quota=True,user_id='27e9252ce2bb4874a2c4205d16ad4fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08799a7-029f-4276-a5de-5ec796132912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08799a7-029f-4276-a5de-5ec796132912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8bf39c-4634-4d9b-b276-cfe39ac4c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8bf39c-4634-4d9b-b276-cfe39ac4c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409d0ca1-e462-4f27-a1e2-dd9167b403bd', 'volume_name': 'volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4629266-5dea-4f1a-9524-a16c33fad3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4629266-5dea-4f1a-9524-a16c33fad3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c37216f-ebc2-437e-82f2-b36fc2fc1b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Volume 409d0ca1-e462-4f27-a1e2-dd9167b403bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd', 'volume_size': 1} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-718514539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d0ca1-e462-4f27-a1e2-dd9167b403bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895335a9cf6045158cf4e5b537b310af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:10Z,use_quota=True,user_id='27e9252ce2bb4874a2c4205d16ad4fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Creating volume 409d0ca1-e462-4f27-a1e2-dd9167b403bd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:54:09 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:09 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd 1073741824 Sep 06 22:54:09 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (81799d0f-5491-4a30-b034-746dbbcd8c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166cfa6d-ef9c-4c28-8b28-74d4c0908921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166cfa6d-ef9c-4c28-8b28-74d4c0908921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854935112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f638e-2c83-40ca-8a83-60790dffc746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:10Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab0059a-6318-4437-883a-14eb3406465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab0059a-6318-4437-883a-14eb3406465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115ba739-7d16-4e2d-9e74-21e33bdfb08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115ba739-7d16-4e2d-9e74-21e33bdfb08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992f638e-2c83-40ca-8a83-60790dffc746', 'volume_name': 'volume-992f638e-2c83-40ca-8a83-60790dffc746', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b1ff47-7952-41f8-94ce-42849b8b86b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b1ff47-7952-41f8-94ce-42849b8b86b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9bd1f7-edcc-4381-b4ee-667f55bdaebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Volume 992f638e-2c83-40ca-8a83-60790dffc746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992f638e-2c83-40ca-8a83-60790dffc746', 'volume_size': 1} Sep 06 22:54:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:10 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd 1073741824" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:10 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd Sep 06 22:54:10 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:10 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.550s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854935112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f638e-2c83-40ca-8a83-60790dffc746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:10Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Creating volume 992f638e-2c83-40ca-8a83-60790dffc746 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:54:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:10 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 1073741824 Sep 06 22:54:10 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c37216f-ebc2-437e-82f2-b36fc2fc1b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fea7e5a-7db8-4463-b95a-50b563c8d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Volume volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd (409d0ca1-e462-4f27-a1e2-dd9167b403bd): created successfully Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fea7e5a-7db8-4463-b95a-50b563c8d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Flow 'volume_create_manager' (56cd5137-f06a-4ce4-be84-c70b7e677d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fc6f0f8c-a8d8-4e86-ad7d-ac745320ca84 tempest-TestMinimumBasicScenario-26320645 None] Created volume successfully. Sep 06 22:54:10 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 1073741824" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:10 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 Sep 06 22:54:10 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:11 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9bd1f7-edcc-4381-b4ee-667f55bdaebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992f638e-2c83-40ca-8a83-60790dffc746', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3db9eae-0b71-43a4-b0d7-fc82c18ff362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=93,cinder:SELECT=70,cinder:DELETE=11,cinder:INSERT=22 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:54:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Volume volume-992f638e-2c83-40ca-8a83-60790dffc746 (992f638e-2c83-40ca-8a83-60790dffc746): created successfully Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3db9eae-0b71-43a4-b0d7-fc82c18ff362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (81799d0f-5491-4a30-b034-746dbbcd8c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-93daa26d-803a-4658-93fc-85aac904dd5b tempest-VolumesTestJSON-1476430573 None] Created volume successfully. Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=83,cinder:INSERT=19,cinder:UPDATE=88,cinder:DELETE=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (8352d442-3f27-4136-89c9-111cc153f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab29b0c0-a26e-4c87-86c9-c9548dc975cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab29b0c0-a26e-4c87-86c9-c9548dc975cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425758602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b2f41c-da1c-42b0-aeb6-0b94680c69c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:12Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df2460f-5b3e-4ef3-b586-2fc1a1a79ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df2460f-5b3e-4ef3-b586-2fc1a1a79ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1792c04-b223-42c5-953e-4e63bb3bd8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1792c04-b223-42c5-953e-4e63bb3bd8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b2f41c-da1c-42b0-aeb6-0b94680c69c7', 'volume_name': 'volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f723c40-5e4e-4ed0-b8e4-22ba56fa78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f723c40-5e4e-4ed0-b8e4-22ba56fa78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27536527-d773-43d9-ab6c-375dd86e6322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Volume f2b2f41c-da1c-42b0-aeb6-0b94680c69c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7', 'volume_size': 1} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425758602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b2f41c-da1c-42b0-aeb6-0b94680c69c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:12Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Creating volume f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:54:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:12 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 1073741824 Sep 06 22:54:12 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3fdc4fac-0f64-495c-a56a-e46f1e68c95c req-8ac84840-7a74-4b9d-b37d-bc2397f17595 tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:13 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 1073741824" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:13 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 Sep 06 22:54:13 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:13 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3fdc4fac-0f64-495c-a56a-e46f1e68c95c req-8ac84840-7a74-4b9d-b37d-bc2397f17595 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27536527-d773-43d9-ab6c-375dd86e6322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7416ea-a20c-44b8-9d34-a1520379f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3fdc4fac-0f64-495c-a56a-e46f1e68c95c req-8ac84840-7a74-4b9d-b37d-bc2397f17595 tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Volume volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 (f2b2f41c-da1c-42b0-aeb6-0b94680c69c7): created successfully Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7416ea-a20c-44b8-9d34-a1520379f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (8352d442-3f27-4136-89c9-111cc153f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2ec30470-c684-4acd-8785-24ccfaa1188a tempest-VolumesTestJSON-1476430573 None] Created volume successfully. Sep 06 22:54:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-3fdc4fac-0f64-495c-a56a-e46f1e68c95c req-8ac84840-7a74-4b9d-b37d-bc2397f17595 tempest-TestMinimumBasicScenario-26320645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94373523-54dd-4f77-bdba-ee82ba069363', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:54:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-3fdc4fac-0f64-495c-a56a-e46f1e68c95c req-8ac84840-7a74-4b9d-b37d-bc2397f17595 tempest-TestMinimumBasicScenario-26320645 None] attachment_update completed successfully. Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (64658bb9-0d74-4cf1-a9f0-cd1923b45dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449f7e9f-92ce-4388-b462-b975c99695ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449f7e9f-92ce-4388-b462-b975c99695ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1740078611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24001296-5176-4914-a115-eba4412851e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:14Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c62042e-2888-4332-9cd6-cea037e803df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c62042e-2888-4332-9cd6-cea037e803df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244300b8-55d5-4206-b224-3111e727a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244300b8-55d5-4206-b224-3111e727a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24001296-5176-4914-a115-eba4412851e5', 'volume_name': 'volume-24001296-5176-4914-a115-eba4412851e5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33482699-bfb1-49a9-a55c-15de7ca0c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33482699-bfb1-49a9-a55c-15de7ca0c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f87e0a7-f2b3-403d-a753-75df24481f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Volume 24001296-5176-4914-a115-eba4412851e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24001296-5176-4914-a115-eba4412851e5', 'volume_size': 1} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1740078611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24001296-5176-4914-a115-eba4412851e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bc30209797a446bad2924e9fefabc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:14Z,use_quota=True,user_id='92144469205e4693908e475ae94d582c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Creating volume 24001296-5176-4914-a115-eba4412851e5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:54:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:14 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 1073741824 Sep 06 22:54:14 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:14 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 1073741824" returned: 0 in 0.483s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:14 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 Sep 06 22:54:14 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:15 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f87e0a7-f2b3-403d-a753-75df24481f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24001296-5176-4914-a115-eba4412851e5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ec15fa-a60a-405b-b360-721dda38b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Volume volume-24001296-5176-4914-a115-eba4412851e5 (24001296-5176-4914-a115-eba4412851e5): created successfully Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ec15fa-a60a-405b-b360-721dda38b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Flow 'volume_create_manager' (64658bb9-0d74-4cf1-a9f0-cd1923b45dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-29f81bc2-5b05-4f95-82e4-9b0f05c4ae96 tempest-VolumesTestJSON-1476430573 None] Created volume successfully. Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-24001296-5176-4914-a115-eba4412851e5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-24001296-5176-4914-a115-eba4412851e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-quobyte-24001296-5176-4914-a115-eba4412851e5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-24001296-5176-4914-a115-eba4412851e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f5b8e8-7fe6-4f7c-bff6-643eb755056d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:17 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 Sep 06 22:54:17 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:17 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:17 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5 Sep 06 22:54:17 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:18 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-24001296-5176-4914-a115-eba4412851e5" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-24001296-5176-4914-a115-eba4412851e5" released by "delete_volume" :: held 1.048s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Created reservations ['e6222a6a-9835-43f5-ba3e-c128a8d612c7', 'f8467e9f-c939-4c82-abe4-50ce3ceafe5e', 'beb9e264-f1d0-4caa-9089-2dffd135253a', '9ebcc51a-89aa-45f0-951f-b9e09aa3fe2e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:18 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:18 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:18 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Deleted volume successfully. Sep 06 22:54:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca9ba0ba-a7a2-4194-86b8-944407ad2b98 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-24001296-5176-4914-a115-eba4412851e5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-quobyte-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe409f-f170-4379-93a5-bdbe66318173]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:19 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 Sep 06 22:54:19 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:20 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" returned: 0 in 0.429s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:20 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7 Sep 06 22:54:20 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:20 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7" released by "delete_volume" :: held 0.754s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Created reservations ['1090c869-ad1d-4359-8b4c-39cbe1f5f343', 'b0aa4ed0-1229-4eb5-909f-7e19faf01dba', 'd8dcbf7d-1dae-433f-a172-4c91fe24574d', '0c62a8f5-a383-41ee-97e4-51e15a7138d9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:20 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:20 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:20 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-992f638e-2c83-40ca-8a83-60790dffc746-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Deleted volume successfully. Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-510c3ef5-a96b-4e03-a301-277227877463 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-f2b2f41c-da1c-42b0-aeb6-0b94680c69c7-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-992f638e-2c83-40ca-8a83-60790dffc746-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "cinder-quobyte-992f638e-2c83-40ca-8a83-60790dffc746" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-992f638e-2c83-40ca-8a83-60790dffc746" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[233737da-60bd-400f-91ff-d105eaab1626]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:21 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 Sep 06 22:54:21 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:21 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:21 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746 Sep 06 22:54:21 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:21 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-992f638e-2c83-40ca-8a83-60790dffc746" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-quobyte-992f638e-2c83-40ca-8a83-60790dffc746" released by "delete_volume" :: held 0.661s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Created reservations ['5b3f6569-634e-4f9c-92a6-3d4aba00c2e2', 'f29114c9-48be-4dfe-9579-96bd1ec0680b', 'ea9db355-8b40-44c9-ac53-01eece85e098', '00de729b-b595-4cb5-a71b-a39256e3ebba'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:21 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:21 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:21 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Deleted volume successfully. Sep 06 22:54:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d5069ce-cf9e-4904-8087-da797b0a3168 tempest-VolumesTestJSON-1476430573 None] Lock "cinder-992f638e-2c83-40ca-8a83-60790dffc746-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ecb047b-04e2-498a-902a-d748c431c28f tempest-GroupsV314Test-1143510952 None] Group tempest-GroupsV314Test-Group-1354340409: creating Sep 06 22:54:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ecb047b-04e2-498a-902a-d748c431c28f tempest-GroupsV314Test-1143510952 None] Group tempest-GroupsV314Test-Group-1354340409: created successfully Sep 06 22:54:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ecb047b-04e2-498a-902a-d748c431c28f tempest-GroupsV314Test-1143510952 None] Create group completed successfully. Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Flow 'volume_create_manager' (cc6b56ba-2002-4830-862d-ae4e66827119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88797f9f-c0bd-4a7a-8483-f34c855f9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88797f9f-c0bd-4a7a-8483-f34c855f9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927699111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b80f06d1-a3d7-497e-9efc-537ad2b91508,host='devstack@QuobyteHD#QuobyteHD',id=46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab7f5f53494caa8d1d1a776116a4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:33Z,use_quota=True,user_id='52f4bdd56e5f4f41ab0019da3ad09b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6657d2-8c9d-4a2d-9c4f-1620d8a08f82),volume_type_id=ca6657d2-8c9d-4a2d-9c4f-1620d8a08f82)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680ce7f9-678b-41c3-a48e-046619303f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680ce7f9-678b-41c3-a48e-046619303f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78134cf3-2bc2-470c-9759-1993db6d1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78134cf3-2bc2-470c-9759-1993db6d1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76', 'volume_name': 'volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c450eb12-8a7f-4041-8577-c45ca5695c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c450eb12-8a7f-4041-8577-c45ca5695c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18554945-1df9-4e28-be90-780809bb607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Volume 46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76', 'volume_size': 1} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b80f06d1-a3d7-497e-9efc-537ad2b91508,created_at=2026-09-06T20:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927699111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b80f06d1-a3d7-497e-9efc-537ad2b91508,host='devstack@QuobyteHD#QuobyteHD',id=46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab7f5f53494caa8d1d1a776116a4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:54:33Z,use_quota=True,user_id='52f4bdd56e5f4f41ab0019da3ad09b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6657d2-8c9d-4a2d-9c4f-1620d8a08f82),volume_type_id=ca6657d2-8c9d-4a2d-9c4f-1620d8a08f82)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Creating volume 46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:54:32 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:54:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:32 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 1073741824 Sep 06 22:54:32 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:33 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 1073741824" returned: 0 in 0.427s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:33 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:33 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:33 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18554945-1df9-4e28-be90-780809bb607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c808a514-5def-4d35-89b7-fc91e94beabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:54:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Volume volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 (46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76): created successfully Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c808a514-5def-4d35-89b7-fc91e94beabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:54:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Flow 'volume_create_manager' (cc6b56ba-2002-4830-862d-ae4e66827119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:54:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8a054c00-6e12-45c7-a950-a35e9d69186b tempest-GroupsV314Test-1143510952 None] Created volume successfully. Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:34 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Cloning volume 46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 to volume 2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Creating offline snapshot 147c0ce4-0696-4627-9099-f6bee5b14147 of volume 46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c4126-cd11-462d-b743-a2ede740a360]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:34 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:34 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:34 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:34 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 1G Sep 06 22:54:34 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:35 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 1G" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:35 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:35 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:35 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:35 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:35 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:35 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:35 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:35 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info Sep 06 22:54:35 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:36 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:36 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info Sep 06 22:54:36 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:36 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.info" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Acquiring lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] snapshot: 147c0ce4-0696-4627-9099-f6bee5b14147, volume: 2c725a2b-029f-4ab6-86e6-1b28fddb2ad4, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d2b64-53be-4c3c-8275-1a20a825864b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:36 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:36 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:36 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d81c9-4168-4691-8e53-019de90e6db0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:36 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:36 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:37 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:54:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:54:37 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:54:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:37 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 Sep 06 22:54:37 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:42 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" returned: 0 in 5.202s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:54:42 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Converted 1024.00 MB image at 196.70 MB/s Sep 06 22:54:42 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:42 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 Sep 06 22:54:42 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:42 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" released by "_copy_volume_from_snapshot" :: held 6.293s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Acquiring lock "cinder-quobyte-147c0ce4-0696-4627-9099-f6bee5b14147" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-147c0ce4-0696-4627-9099-f6bee5b14147" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Deleting offline snapshot 147c0ce4-0696-4627-9099-f6bee5b14147 of volume 46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] snapshot_file for this snap is: volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347899a-dca5-468c-81f4-ac0f834d5f19]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:42 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:42 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:43 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c8f13-0c44-48d2-bcf6-771decd2e788]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:43 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:43 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:43 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:43 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:43 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:44 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:44 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147 Sep 06 22:54:44 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:44 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76.147c0ce4-0696-4627-9099-f6bee5b14147" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-147c0ce4-0696-4627-9099-f6bee5b14147" released by "_delete_snapshot" :: held 1.550s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.906s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3f847d5a-2d36-4d32-8778-bf8f55946011 tempest-GroupsV314Test-1143510952 None] Create group from source-group-b80f06d1-a3d7-497e-9efc-537ad2b91508 completed successfully. Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Acquiring lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae56f40-ed9c-4d46-a3bf-8ff498688cad]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:45 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 Sep 06 22:54:45 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:45 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:45 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4 Sep 06 22:54:45 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:45 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-2c725a2b-029f-4ab6-86e6-1b28fddb2ad4" released by "delete_volume" :: held 0.685s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Created reservations ['638ee997-bb92-4914-95cf-b509a544c5d6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:46 devstack cinder-volume[87517]: WARNING cinder.quota [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1286788619 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1286788619, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:54:46 devstack cinder-volume[87517]: WARNING cinder.quota [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1286788619 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1286788619, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Created reservations ['6a61a61d-2603-439d-8346-f927773bf3d0', '75ed95e6-3145-4acb-8186-0357fab95a36', '82e88a4b-01d2-426f-b357-529aca33df77', 'cd268538-628e-4e3a-a526-7f714df08bf8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:46 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:46 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:46 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-39e18ee6-6d67-4354-9762-f2dc8327fd86 tempest-GroupsV314Test-1143510952 None] Delete group completed successfully. Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Acquiring lock "cinder-quobyte-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f898c5-6f15-488f-a8a8-c43da5389b39]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:54:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:46 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:46 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:47 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:47 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76 Sep 06 22:54:47 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:47 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Lock "cinder-quobyte-46c8a236-b3cb-4e8a-bdb7-4802ab7cdb76" released by "delete_volume" :: held 0.670s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Created reservations ['deb12791-8a2f-404b-a932-586ae69bc33d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Created reservations ['cfce8677-6dd9-4c3c-9498-7d1f547cd266', 'e2c7ec9e-0110-430e-85de-7722b74e1252', '065125f6-5fba-4220-834e-761e1493cbc5', '423c6463-058e-42cd-933d-288dfad36721'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:47 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:47 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:47 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6c77b55a-2d8e-4e90-8918-ecbdeffb8b35 tempest-GroupsV314Test-1143510952 None] Delete group completed successfully. Sep 06 22:54:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-01908caa-88e6-4717-af82-0bc7a2c655f1 tempest-GroupsV320Test-666785579 None] Group tempest-GroupsV320Test-Group-1043564317: creating Sep 06 22:54:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-01908caa-88e6-4717-af82-0bc7a2c655f1 tempest-GroupsV320Test-666785579 None] Group tempest-GroupsV320Test-Group-1043564317: created successfully Sep 06 22:54:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-01908caa-88e6-4717-af82-0bc7a2c655f1 tempest-GroupsV320Test-666785579 None] Create group completed successfully. Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Created reservations ['3d617ab2-be53-427f-b607-0ca897bfeca1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:54:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:54:54 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:54:54 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:54:55 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 06 22:54:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:54:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:54:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-485e235f-a380-41f8-813b-bd130bc39fb1 tempest-GroupsV320Test-666785579 None] Delete group completed successfully. Sep 06 22:55:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-0cca2442-8f98-4854-a6cf-8c6413cabecf req-c01d8617-a680-4289-8a72-6e0fddf6471d tempest-TestMinimumBasicScenario-26320645 None] Terminate volume connection completed successfully. Sep 06 22:55:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-0cca2442-8f98-4854-a6cf-8c6413cabecf req-c01d8617-a680-4289-8a72-6e0fddf6471d tempest-TestMinimumBasicScenario-26320645 None] Deleting attachment 94373523-54dd-4f77-bdba-ee82ba069363. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "cinder-409d0ca1-e462-4f27-a1e2-dd9167b403bd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "cinder-409d0ca1-e462-4f27-a1e2-dd9167b403bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "cinder-quobyte-409d0ca1-e462-4f27-a1e2-dd9167b403bd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "cinder-quobyte-409d0ca1-e462-4f27-a1e2-dd9167b403bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e835b-ee90-4783-ab5a-91e148a6ab68]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:02 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd Sep 06 22:55:02 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:02 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:02 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd Sep 06 22:55:02 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:02 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-409d0ca1-e462-4f27-a1e2-dd9167b403bd" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "cinder-quobyte-409d0ca1-e462-4f27-a1e2-dd9167b403bd" released by "delete_volume" :: held 0.648s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Created reservations ['08ae212b-7de1-43fe-8a7a-4662265a7aea', 'd4952144-00b3-4c7a-859a-591948202ea8', 'feb22cb5-b988-4457-9c5f-3f49c15a50f7', '6f4ab8e7-2873-47ae-8de1-3ee7e678e9b7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:03 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:55:03 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:03 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:55:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Deleted volume successfully. Sep 06 22:55:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ddc778ec-2806-4cd2-b53f-4706f6c3fa5a tempest-TestMinimumBasicScenario-26320645 None] Lock "cinder-409d0ca1-e462-4f27-a1e2-dd9167b403bd-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:05 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:55:05 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:05 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:55:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:55:13 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=65,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:55:13 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=69,cinder:SELECT=64,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Flow 'volume_create_manager' (de5ee991-5156-42a7-9985-5195458455ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3702b13b-4cb1-4ade-9278-4172992a9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3702b13b-4cb1-4ade-9278-4172992a9248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-52167098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae920aa1-599d-416b-8271-feffb37bdfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ab1a5532a347298e75779cf4ef6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:21Z,use_quota=True,user_id='ff0ad100a901432686d1acfb27ceccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983e3c33-0cb4-48bb-a1d8-6c0c4de3e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983e3c33-0cb4-48bb-a1d8-6c0c4de3e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f1649-c8cf-48fc-8346-8ef11d1f1b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f1649-c8cf-48fc-8346-8ef11d1f1b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae920aa1-599d-416b-8271-feffb37bdfee', 'volume_name': 'volume-ae920aa1-599d-416b-8271-feffb37bdfee', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd8ca5-cbd1-48d3-9dd6-6edec227fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd8ca5-cbd1-48d3-9dd6-6edec227fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11edf50a-53d6-499d-8384-6fa7791f9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Volume ae920aa1-599d-416b-8271-feffb37bdfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae920aa1-599d-416b-8271-feffb37bdfee', 'volume_size': 1} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-52167098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae920aa1-599d-416b-8271-feffb37bdfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ab1a5532a347298e75779cf4ef6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:21Z,use_quota=True,user_id='ff0ad100a901432686d1acfb27ceccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Creating volume ae920aa1-599d-416b-8271-feffb37bdfee {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:55:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:21 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee 1073741824 Sep 06 22:55:21 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:21 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee 1073741824" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:21 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee Sep 06 22:55:21 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:22 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11edf50a-53d6-499d-8384-6fa7791f9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae920aa1-599d-416b-8271-feffb37bdfee', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2387fd50-a5a5-4d1d-a51d-96e80746554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Volume volume-ae920aa1-599d-416b-8271-feffb37bdfee (ae920aa1-599d-416b-8271-feffb37bdfee): created successfully Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2387fd50-a5a5-4d1d-a51d-96e80746554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Flow 'volume_create_manager' (de5ee991-5156-42a7-9985-5195458455ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-46aa88e7-06f6-41a8-93ef-9cf92b0f5870 tempest-VolumesTransfersTest-56916748 None] Created volume successfully. Sep 06 22:55:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9a554e8d-005d-4127-bf2e-88ecbc738836 tempest-VolumesTransfersTest-193052753 None] Transfer volume completed successfully. Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "cinder-ae920aa1-599d-416b-8271-feffb37bdfee-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-ae920aa1-599d-416b-8271-feffb37bdfee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "cinder-quobyte-ae920aa1-599d-416b-8271-feffb37bdfee" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-quobyte-ae920aa1-599d-416b-8271-feffb37bdfee" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb07e90-1e6d-44c1-a00f-44ea66901229]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:23 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee Sep 06 22:55:23 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:24 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:24 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee Sep 06 22:55:24 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:24 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae920aa1-599d-416b-8271-feffb37bdfee" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-quobyte-ae920aa1-599d-416b-8271-feffb37bdfee" released by "delete_volume" :: held 0.696s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Created reservations ['4dd390a6-baf6-47b7-8925-21d2b432d629', '11691ce4-3ffa-473f-9348-d3d913f813fc', 'b363861a-ae6d-45ed-be74-35ded16d1302', 'e74a87c1-670b-449f-83c1-075fc35c6f32'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:24 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:55:24 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:24 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:55:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Deleted volume successfully. Sep 06 22:55:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d672db36-829f-45a0-bb06-c584c5aab6f3 tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-ae920aa1-599d-416b-8271-feffb37bdfee-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Flow 'volume_create_manager' (2130346b-018e-4f97-93d4-1ce13aca0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e0ba2f-6941-4684-a048-acdaaf161677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e0ba2f-6941-4684-a048-acdaaf161677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-581263339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1268842c-184f-4ea0-b8ac-9266847d05e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ab1a5532a347298e75779cf4ef6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:25Z,use_quota=True,user_id='ff0ad100a901432686d1acfb27ceccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d889b1eb-71a6-4439-b9a6-e238f47b75c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d889b1eb-71a6-4439-b9a6-e238f47b75c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8feb81-2b0f-4645-85bb-b9ddf63c494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8feb81-2b0f-4645-85bb-b9ddf63c494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1268842c-184f-4ea0-b8ac-9266847d05e3', 'volume_name': 'volume-1268842c-184f-4ea0-b8ac-9266847d05e3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41346825-0081-42be-bddd-6c446047f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41346825-0081-42be-bddd-6c446047f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf2626d-c7e1-42ef-a159-3ae1b9070618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Volume 1268842c-184f-4ea0-b8ac-9266847d05e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1268842c-184f-4ea0-b8ac-9266847d05e3', 'volume_size': 1} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-581263339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1268842c-184f-4ea0-b8ac-9266847d05e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ab1a5532a347298e75779cf4ef6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:25Z,use_quota=True,user_id='ff0ad100a901432686d1acfb27ceccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Creating volume 1268842c-184f-4ea0-b8ac-9266847d05e3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:55:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:25 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 1073741824 Sep 06 22:55:25 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:25 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 1073741824" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:26 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 Sep 06 22:55:26 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:26 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf2626d-c7e1-42ef-a159-3ae1b9070618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1268842c-184f-4ea0-b8ac-9266847d05e3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0c939b-fab0-426a-be3f-e7c67b4ed6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Volume volume-1268842c-184f-4ea0-b8ac-9266847d05e3 (1268842c-184f-4ea0-b8ac-9266847d05e3): created successfully Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0c939b-fab0-426a-be3f-e7c67b4ed6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Flow 'volume_create_manager' (2130346b-018e-4f97-93d4-1ce13aca0405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cbf22c1b-c7b8-4de7-ab1a-593524a4e685 tempest-VolumesTransfersTest-56916748 None] Created volume successfully. Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "cinder-1268842c-184f-4ea0-b8ac-9266847d05e3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-1268842c-184f-4ea0-b8ac-9266847d05e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "cinder-quobyte-1268842c-184f-4ea0-b8ac-9266847d05e3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-quobyte-1268842c-184f-4ea0-b8ac-9266847d05e3" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fe2c2c-77fd-4a16-997f-da39f169b3a1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:28 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 Sep 06 22:55:28 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:28 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:28 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3 Sep 06 22:55:28 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:28 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1268842c-184f-4ea0-b8ac-9266847d05e3" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-quobyte-1268842c-184f-4ea0-b8ac-9266847d05e3" released by "delete_volume" :: held 0.691s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Created reservations ['a33bc601-3974-4227-8831-b9dea490ea68', 'cc40f32b-fb66-44ea-8faa-fb4dbab085d2', '9444ae7a-b6f7-44a0-8af8-467ba6d56478', '18ad873c-1648-4c78-8947-0df2937d7caa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:28 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:55:28 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:28 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:28 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:55:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Deleted volume successfully. Sep 06 22:55:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8199371c-7d8f-4eb0-8537-1d0fa0366fdd tempest-VolumesTransfersTest-1045138458 None] Lock "cinder-1268842c-184f-4ea0-b8ac-9266847d05e3-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Flow 'volume_create_manager' (98a1c8e6-0b90-46a0-a41b-ca95853fca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f488839a-1ffa-4a61-bdc9-c7bf01509a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f488839a-1ffa-4a61-bdc9-c7bf01509a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1209309806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1138fe9-a40a-4b26-8363-e5bafd22db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009261c925f04767a0bcfb691e204ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:37Z,use_quota=True,user_id='d34f70b854a04213ae9175f0639e7ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d0ac42-1671-417f-8366-5b755dfc051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d0ac42-1671-417f-8366-5b755dfc051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d8eb9-0938-4a17-b8a9-c85cbc1b50c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d8eb9-0938-4a17-b8a9-c85cbc1b50c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1138fe9-a40a-4b26-8363-e5bafd22db06', 'volume_name': 'volume-f1138fe9-a40a-4b26-8363-e5bafd22db06', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46816c8-8542-4ce0-bdd0-4adf67226ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46816c8-8542-4ce0-bdd0-4adf67226ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d583fc6-d30c-418a-b508-860c932a10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Volume f1138fe9-a40a-4b26-8363-e5bafd22db06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1138fe9-a40a-4b26-8363-e5bafd22db06', 'volume_size': 1} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1209309806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1138fe9-a40a-4b26-8363-e5bafd22db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='009261c925f04767a0bcfb691e204ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:37Z,use_quota=True,user_id='d34f70b854a04213ae9175f0639e7ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Creating volume f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:55:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:55:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:36 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 1073741824 Sep 06 22:55:36 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:37 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 1073741824" returned: 0 in 0.475s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:37 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:55:37 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:37 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d583fc6-d30c-418a-b508-860c932a10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1138fe9-a40a-4b26-8363-e5bafd22db06', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84563dfd-05ab-4730-b862-1d0ea0f0b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Volume volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 (f1138fe9-a40a-4b26-8363-e5bafd22db06): created successfully Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84563dfd-05ab-4730-b862-1d0ea0f0b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Flow 'volume_create_manager' (98a1c8e6-0b90-46a0-a41b-ca95853fca60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-934ce270-c1ad-48c7-af47-b2b194cdddbd tempest-TestImageHashVerification-550175455 None] Created volume successfully. Sep 06 22:55:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:55:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:55:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1538f5-c263-440f-8430-8a643b1158c1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:39 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:55:39 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:40 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f48253-9ffa-4b62-af95-8901c67a36bd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:40 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:55:40 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:40 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 /opt/stack/data/cinder/conversion/f1138fe9-a40a-4b26-8363-e5bafd22db06.temp_image.d0b5b4d9-7a3f-45fb-a597-cc13ab093c66rty_bhaq.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:40 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 /opt/stack/data/cinder/conversion/f1138fe9-a40a-4b26-8363-e5bafd22db06.temp_image.d0b5b4d9-7a3f-45fb-a597-cc13ab093c66rty_bhaq.img Sep 06 22:55:40 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:45 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 /opt/stack/data/cinder/conversion/f1138fe9-a40a-4b26-8363-e5bafd22db06.temp_image.d0b5b4d9-7a3f-45fb-a597-cc13ab093c66rty_bhaq.img" returned: 0 in 5.010s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10aa72-c9a5-4bd3-9c5a-fb22bb46d55b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:55:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:55:45 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:55:45 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:55:46 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 06 22:55:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.554s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:55:46 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/f1138fe9-a40a-4b26-8363-e5bafd22db06.temp_image.d0b5b4d9-7a3f-45fb-a597-cc13ab093c66rty_bhaq.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:55:46 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Converted 1024.00 MB image at 204.35 MB/s Sep 06 22:55:46 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] d0b5b4d9-7a3f-45fb-a597-cc13ab093c66 was raw, no need to convert to raw {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Flow 'volume_create_manager' (4c8ff385-c966-4c47-9296-83f4c7373f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d361d8a9-ef99-406f-a994-4e4305cabee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d361d8a9-ef99-406f-a994-4e4305cabee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131694043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c1f173-e42d-4087-a4fc-a9644b877040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92ff785518e4380b702e06fd208984d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:48Z,use_quota=True,user_id='641b3a55ae1c4683ab89d4a670bcb319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6183eeb8-f915-4a10-a292-38734c8cf607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6183eeb8-f915-4a10-a292-38734c8cf607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae8a4c3-4af1-44e7-9410-bc786cd7913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae8a4c3-4af1-44e7-9410-bc786cd7913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c1f173-e42d-4087-a4fc-a9644b877040', 'volume_name': 'volume-a0c1f173-e42d-4087-a4fc-a9644b877040', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46b49fa-03c4-4baa-897f-4fed13fb7c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46b49fa-03c4-4baa-897f-4fed13fb7c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6363c1ca-52a4-4341-aa22-eef4e2cec63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:55:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Volume a0c1f173-e42d-4087-a4fc-a9644b877040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c1f173-e42d-4087-a4fc-a9644b877040', 'volume_size': 1} Sep 06 22:55:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.610s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Uploaded volume to glance image-id: d0b5b4d9-7a3f-45fb-a597-cc13ab093c66. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.966s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131694043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c1f173-e42d-4087-a4fc-a9644b877040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92ff785518e4380b702e06fd208984d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:55:48Z,use_quota=True,user_id='641b3a55ae1c4683ab89d4a670bcb319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Creating volume a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:56:05 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c363ee27-d95d-438f-80db-701ed6bc24ac tempest-TestImageHashVerification-550175455 None] Copy volume to image completed successfully. Sep 06 22:56:05 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 1073741824 Sep 06 22:56:05 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:05 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:56:05 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:05 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 1073741824" returned: 0 in 0.452s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:05 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:56:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:05 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:05 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:06 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6363c1ca-52a4-4341-aa22-eef4e2cec63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c1f173-e42d-4087-a4fc-a9644b877040', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d55622f-fdcf-4c9e-a9df-8ba0cbb5aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Volume volume-a0c1f173-e42d-4087-a4fc-a9644b877040 (a0c1f173-e42d-4087-a4fc-a9644b877040): created successfully Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d55622f-fdcf-4c9e-a9df-8ba0cbb5aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Flow 'volume_create_manager' (4c8ff385-c966-4c47-9296-83f4c7373f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f8814b5e-593c-4001-9fba-c2acd59769fc tempest-VolumesActionsTest-1562909690 None] Created volume successfully. Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Acquiring lock "cinder-f1138fe9-a40a-4b26-8363-e5bafd22db06-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "cinder-f1138fe9-a40a-4b26-8363-e5bafd22db06-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Acquiring lock "cinder-quobyte-f1138fe9-a40a-4b26-8363-e5bafd22db06" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "cinder-quobyte-f1138fe9-a40a-4b26-8363-e5bafd22db06" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f52df6-4912-4f97-af94-a7d6f3bedccf]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:06 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:56:06 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:06 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:06 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06 Sep 06 22:56:06 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:07 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f1138fe9-a40a-4b26-8363-e5bafd22db06" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "cinder-quobyte-f1138fe9-a40a-4b26-8363-e5bafd22db06" released by "delete_volume" :: held 0.685s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Created reservations ['b6be2099-a925-4470-8f2b-706eade13df6', 'c6430b07-00ce-4480-ab56-f3c00044415f', '719e9af8-a4bd-439f-bbdb-d81deb140d7e', '886e3bb4-546f-4c07-9079-197c69afcb48'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:07 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:56:07 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:07 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:56:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Deleted volume successfully. Sep 06 22:56:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6f158f54-d583-48f1-9e82-9960667db921 tempest-TestImageHashVerification-550175455 None] Lock "cinder-f1138fe9-a40a-4b26-8363-e5bafd22db06-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6743b7c4-474e-4f7e-a26d-0646bba07623 tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6743b7c4-474e-4f7e-a26d-0646bba07623 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" acquired by "attach_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=39,cinder:INSERT=10,cinder:SELECT=23,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:56:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6743b7c4-474e-4f7e-a26d-0646bba07623 tempest-VolumesActionsTest-1562909690 None] Attaching volume a0c1f173-e42d-4087-a4fc-a9644b877040 to instance ada4d6a8-116a-4387-9c60-b5a5e09ed879 at mountpoint /dev/vdb on host None. Sep 06 22:56:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6743b7c4-474e-4f7e-a26d-0646bba07623 tempest-VolumesActionsTest-1562909690 None] Attach volume completed successfully. Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6743b7c4-474e-4f7e-a26d-0646bba07623 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" released by "attach_volume" :: held 0.086s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af402bbc-5acc-4010-b37c-c72e8c7eb1ce tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af402bbc-5acc-4010-b37c-c72e8c7eb1ce tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-af402bbc-5acc-4010-b37c-c72e8c7eb1ce tempest-VolumesActionsTest-1562909690 None] Detaching volume a0c1f173-e42d-4087-a4fc-a9644b877040 from instance ada4d6a8-116a-4387-9c60-b5a5e09ed879. Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=36,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:56:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-af402bbc-5acc-4010-b37c-c72e8c7eb1ce tempest-VolumesActionsTest-1562909690 None] Detach volume completed successfully. Sep 06 22:56:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af402bbc-5acc-4010-b37c-c72e8c7eb1ce tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Flow 'volume_create_manager' (b6241be2-e22a-4259-b52c-4c0f68497364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7146295-8f76-4896-95ea-1410033eeda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7146295-8f76-4896-95ea-1410033eeda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-613201408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9687bc20-04ef-4800-8c75-9b4f94aba921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e9643a29184f738b2fa397d11a2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:56:22Z,use_quota=True,user_id='977fef3699194ae2bf08557ce5b87260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145a308e-f4f0-441c-922e-a8cc5f27d77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145a308e-f4f0-441c-922e-a8cc5f27d77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5c09ef-1a9f-448b-b319-4cd9e21549a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5c09ef-1a9f-448b-b319-4cd9e21549a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9687bc20-04ef-4800-8c75-9b4f94aba921', 'volume_name': 'volume-9687bc20-04ef-4800-8c75-9b4f94aba921', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a325802e-03f9-4f82-a59f-02268432f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a325802e-03f9-4f82-a59f-02268432f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5eebc3-2ab0-4ef1-9e1e-847d83b57e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Volume 9687bc20-04ef-4800-8c75-9b4f94aba921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9687bc20-04ef-4800-8c75-9b4f94aba921', 'volume_size': 1} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-613201408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9687bc20-04ef-4800-8c75-9b4f94aba921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e9643a29184f738b2fa397d11a2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:56:22Z,use_quota=True,user_id='977fef3699194ae2bf08557ce5b87260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Creating volume 9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:56:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:56:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:21 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 1073741824 Sep 06 22:56:21 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:22 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 1073741824" returned: 0 in 0.654s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:22 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:22 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:22 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5eebc3-2ab0-4ef1-9e1e-847d83b57e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9687bc20-04ef-4800-8c75-9b4f94aba921', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dde85c8-3f68-4935-8761-ef10e09de13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Volume volume-9687bc20-04ef-4800-8c75-9b4f94aba921 (9687bc20-04ef-4800-8c75-9b4f94aba921): created successfully Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dde85c8-3f68-4935-8761-ef10e09de13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Flow 'volume_create_manager' (b6241be2-e22a-4259-b52c-4c0f68497364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e6a8a861-6f67-4a59-bd71-1ad9c0260eaf tempest-VolumeDependencyTests-626314968 None] Created volume successfully. Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Creating offline snapshot 0686f685-7f99-41f9-a85c-2dd18ef46514 of volume 9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c058b836-c7cb-4add-a882-ffe06435640c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:24 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:24 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:24 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:24 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 1G Sep 06 22:56:24 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30e76e6e-f8e2-4935-9099-edd92fcea1ec tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30e76e6e-f8e2-4935-9099-edd92fcea1ec tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" acquired by "attach_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-30e76e6e-f8e2-4935-9099-edd92fcea1ec tempest-VolumesActionsTest-1562909690 None] Attaching volume a0c1f173-e42d-4087-a4fc-a9644b877040 to instance 64d3ec5d-531f-4492-baa9-3a575f7bd461 at mountpoint /dev/vdb on host None. Sep 06 22:56:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-30e76e6e-f8e2-4935-9099-edd92fcea1ec tempest-VolumesActionsTest-1562909690 None] Attach volume completed successfully. Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-30e76e6e-f8e2-4935-9099-edd92fcea1ec tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040" released by "attach_volume" :: held 0.107s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:24 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 1G" returned: 0 in 0.496s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9687bc20-04ef-4800-8c75-9b4f94aba921 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:24 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9687bc20-04ef-4800-8c75-9b4f94aba921 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:24 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6bf86ab3-79e3-4146-9948-0f4621cbdcf3 tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6bf86ab3-79e3-4146-9948-0f4621cbdcf3 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6bf86ab3-79e3-4146-9948-0f4621cbdcf3 tempest-VolumesActionsTest-1562909690 None] Detaching volume a0c1f173-e42d-4087-a4fc-a9644b877040 from instance 64d3ec5d-531f-4492-baa9-3a575f7bd461. Sep 06 22:56:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6bf86ab3-79e3-4146-9948-0f4621cbdcf3 tempest-VolumesActionsTest-1562909690 None] Detach volume completed successfully. Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6bf86ab3-79e3-4146-9948-0f4621cbdcf3 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:25 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9687bc20-04ef-4800-8c75-9b4f94aba921 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:25 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 is being set with open permissions: ugo+rw Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:25 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:25 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:25 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:25 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info Sep 06 22:56:25 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:26 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:26 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info is being set with open permissions: ugo+rw Sep 06 22:56:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:26 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info Sep 06 22:56:26 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:26 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.info" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-41cf5516-7fb5-4834-9543-542bd95252a0 tempest-VolumeDependencyTests-626314968 None] Create snapshot completed successfully Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Flow 'volume_create_manager' (5a9ab3e6-8bee-415d-bfa8-a4484722871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3fa120-fb73-42ba-92ea-04620e497a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3fa120-fb73-42ba-92ea-04620e497a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211075493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b1af08-e6c7-4748-8329-97bf0f524c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e9643a29184f738b2fa397d11a2267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0686f685-7f99-41f9-a85c-2dd18ef46514,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:56:28Z,use_quota=True,user_id='977fef3699194ae2bf08557ce5b87260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578bc4b1-e1bc-464c-a979-8996c61bd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578bc4b1-e1bc-464c-a979-8996c61bd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542065b4-a73f-4221-bdae-6a86e9077883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542065b4-a73f-4221-bdae-6a86e9077883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45b1af08-e6c7-4748-8329-97bf0f524c1e', 'volume_name': 'volume-45b1af08-e6c7-4748-8329-97bf0f524c1e', 'volume_size': 1, 'snapshot_id': '0686f685-7f99-41f9-a85c-2dd18ef46514'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f836ae36-c073-4930-be81-caac54e8fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f836ae36-c073-4930-be81-caac54e8fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5933424-be97-4ad4-8b6a-e7a2dda83aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Volume 45b1af08-e6c7-4748-8329-97bf0f524c1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45b1af08-e6c7-4748-8329-97bf0f524c1e', 'volume_size': 1, 'snapshot_id': '0686f685-7f99-41f9-a85c-2dd18ef46514'} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514-45b1af08-e6c7-4748-8329-97bf0f524c1e" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514-45b1af08-e6c7-4748-8329-97bf0f524c1e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Creating volume 45b1af08-e6c7-4748-8329-97bf0f524c1e from snapshot 0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] snapshot: 0686f685-7f99-41f9-a85c-2dd18ef46514, volume: 45b1af08-e6c7-4748-8329-97bf0f524c1e, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06369e74-a0a1-4ba7-9e56-deb2a9e18bb7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:27 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:27 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:28 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9687bc20-04ef-4800-8c75-9b4f94aba921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[04845f01-e76b-4654-ad95-400a79af28a7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:28 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:28 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:28 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:56:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:28 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e Sep 06 22:56:28 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:32 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e" returned: 0 in 4.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:32 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:56:32 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Converted 1024.00 MB image at 235.13 MB/s Sep 06 22:56:32 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e is being set with open permissions: ugo+rw Sep 06 22:56:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:32 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e Sep 06 22:56:32 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:33 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e" returned: 0 in 0.239s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" released by "_copy_volume_from_snapshot" :: held 5.441s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514-45b1af08-e6c7-4748-8329-97bf0f524c1e" released by "_create_volume_from_snapshot" :: held 5.501s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.516s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.241s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[64609b6f-330a-42ab-8cf5-3f15042428ce]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5933424-be97-4ad4-8b6a-e7a2dda83aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b1af08-e6c7-4748-8329-97bf0f524c1e', 'volume_size': 1, 'snapshot_id': '0686f685-7f99-41f9-a85c-2dd18ef46514'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7c0783-8ce6-4cc5-b923-41f15fe66eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Volume volume-45b1af08-e6c7-4748-8329-97bf0f524c1e (45b1af08-e6c7-4748-8329-97bf0f524c1e): created successfully Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7c0783-8ce6-4cc5-b923-41f15fe66eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Flow 'volume_create_manager' (5a9ab3e6-8bee-415d-bfa8-a4484722871d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e780e68c-5fbe-4a2c-9903-f109f5003c55 tempest-VolumeDependencyTests-626314968 None] Created volume successfully. Sep 06 22:56:33 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:33 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:33 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada7fee-05a0-4c94-b4a2-1cc7babaa995]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:33 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:33 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:33 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.d521437c-70ae-4e12-83ee-a1f474ab3d217p54pl1d.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:33 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.d521437c-70ae-4e12-83ee-a1f474ab3d217p54pl1d.img Sep 06 22:56:33 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-0686f685-7f99-41f9-a85c-2dd18ef46514-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-0686f685-7f99-41f9-a85c-2dd18ef46514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Deleting offline snapshot 0686f685-7f99-41f9-a85c-2dd18ef46514 of volume 9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] snapshot_file for this snap is: volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c972b5-fcf7-4574-a97e-f02a39448a8f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:34 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:34 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:34 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.610s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9687bc20-04ef-4800-8c75-9b4f94aba921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a66e7-fd3d-4887-8aba-232071174212]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:35 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:35 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:36 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 1.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:36 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:36 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:37 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.830s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:37 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514 Sep 06 22:56:37 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:37 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921.0686f685-7f99-41f9-a85c-2dd18ef46514" returned: 0 in 0.456s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-0686f685-7f99-41f9-a85c-2dd18ef46514" released by "_delete_snapshot" :: held 3.552s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" released by "delete_snapshot" :: held 3.584s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Created reservations ['9e2adad7-1368-4412-b27b-80381d87f30d', 'a8fef38a-a21d-42f7-b238-b3a3b09f983e', '67a5a7b6-15cb-47d3-9b8c-02f4f42bb4e6', '2750e8fd-b3ba-4954-96d6-4fda4cfd4ab2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:56:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Delete snapshot completed successfully. Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19f98da6-d9a0-4458-a5bd-2a1fc63ce359 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-0686f685-7f99-41f9-a85c-2dd18ef46514-delete_snapshot" released by "delete_snapshot" :: held 3.839s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:38 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.d521437c-70ae-4e12-83ee-a1f474ab3d217p54pl1d.img" returned: 0 in 4.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2335dc0-2b68-4268-bdc6-fcfe0a5a00de]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-9687bc20-04ef-4800-8c75-9b4f94aba921-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:38 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:38 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "cinder-9687bc20-04ef-4800-8c75-9b4f94aba921-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028aa67-97f0-46c4-8b60-76712876705b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:38 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:38 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:38 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.550s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.d521437c-70ae-4e12-83ee-a1f474ab3d217p54pl1d.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:56:38 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Converted 1024.00 MB image at 230.99 MB/s Sep 06 22:56:38 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] d521437c-70ae-4e12-83ee-a1f474ab3d21 was raw, no need to convert to raw {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 22:56:39 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:39 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921 Sep 06 22:56:39 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:39 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9687bc20-04ef-4800-8c75-9b4f94aba921" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-9687bc20-04ef-4800-8c75-9b4f94aba921" released by "delete_volume" :: held 0.692s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Created reservations ['fb6fab07-0041-45ae-ad5e-1c5bf5ed9531', '25e63f19-2a9c-4b8e-9b49-4ec35ba7f4e4', 'b62274cd-2a29-431f-a917-8833864378d3', '50e7f847-c699-489d-bbe5-efa6756f6c80'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:39 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:56:39 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:39 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:56:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Deleted volume successfully. Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96c184e9-6a65-4507-bd79-90680ffb7f9a tempest-VolumeDependencyTests-626314968 None] Lock "cinder-9687bc20-04ef-4800-8c75-9b4f94aba921-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-45b1af08-e6c7-4748-8329-97bf0f524c1e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-45b1af08-e6c7-4748-8329-97bf0f524c1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63e8993-d3aa-4c75-b73c-e8978611472a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:39 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e Sep 06 22:56:39 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:40 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:40 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e Sep 06 22:56:40 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:40 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-45b1af08-e6c7-4748-8329-97bf0f524c1e" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-quobyte-45b1af08-e6c7-4748-8329-97bf0f524c1e" released by "delete_volume" :: held 0.673s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Created reservations ['120c7da2-7621-41d1-b4ce-ca6e50f6433b', '03ef2440-dc71-427e-a4d5-cfc1c5acce9b', '95e6abeb-1c10-453e-8f39-607c5da3bfa7', '48b7e88f-aca3-4e16-b6ca-d51cabde54a1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:40 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:56:40 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:40 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:56:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Deleted volume successfully. Sep 06 22:56:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8ec6546-dc20-4dc8-85b1-b29407f1de31 tempest-VolumeDependencyTests-626314968 None] Lock "cinder-45b1af08-e6c7-4748-8329-97bf0f524c1e-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:56:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:56:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Flow 'volume_create_manager' (5c899450-1747-488a-be5a-10fac368e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:56:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9639b8b4-3082-4688-bcc7-75f7da1ac148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9639b8b4-3082-4688-bcc7-75f7da1ac148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a483d6-6544-4cf3-b12a-8e013701f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8090cc023e694e5ca7dfa683b8f895df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:56:47Z,use_quota=True,user_id='a7c2403121364ad49831f832ad25f2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe2a188-3904-4dc2-a200-bedf6ec8f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe2a188-3904-4dc2-a200-bedf6ec8f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ff1f2b-2547-4683-bd8c-16051f1170b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ff1f2b-2547-4683-bd8c-16051f1170b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70a483d6-6544-4cf3-b12a-8e013701f666', 'volume_name': 'volume-70a483d6-6544-4cf3-b12a-8e013701f666', 'volume_size': 1, 'image_id': '9cdfe306-7dd9-4219-9526-855c99804584', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f111678aadbd6424ce24c8dece97f2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8090cc023e694e5ca7dfa683b8f895df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae834d51a9249885788f4f72f8bd92a929987d2e6ea9e9fdc30910dd4aaba8615a559bd59d3545383a5a9eb3a0e59373aa69d3a9d557d8315a05507bffe47eb6', 'id': '9cdfe306-7dd9-4219-9526-855c99804584', 'created_at': datetime.datetime(2026, 9, 6, 20, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cdfe306-7dd9-4219-9526-855c99804584/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87090aa8-8d2d-4cb9-8433-33598203300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87090aa8-8d2d-4cb9-8433-33598203300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dd73c9-5136-477c-bf4d-ac19c9dfedbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:56:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Volume 70a483d6-6544-4cf3-b12a-8e013701f666: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70a483d6-6544-4cf3-b12a-8e013701f666', 'volume_size': 1, 'image_id': '9cdfe306-7dd9-4219-9526-855c99804584', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f111678aadbd6424ce24c8dece97f2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8090cc023e694e5ca7dfa683b8f895df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae834d51a9249885788f4f72f8bd92a929987d2e6ea9e9fdc30910dd4aaba8615a559bd59d3545383a5a9eb3a0e59373aa69d3a9d557d8315a05507bffe47eb6', 'id': '9cdfe306-7dd9-4219-9526-855c99804584', 'created_at': datetime.datetime(2026, 9, 6, 20, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cdfe306-7dd9-4219-9526-855c99804584/file', 'properties': {}}, 'image_service': } Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Trying to clone 70a483d6-6544-4cf3-b12a-8e013701f666 from image 9cdfe306-7dd9-4219-9526-855c99804584 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:56:47 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Image download 0.00 MB at 0.00 MB/s Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adcecfd-a1be-4ffc-a940-f9d2f6e90ae6]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:47 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:47 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:47 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:47 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:47 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:48 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Temporary image 9cdfe306-7dd9-4219-9526-855c99804584 is fetched for user a7c2403121364ad49831f832ad25f2df. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32d7f62-3727-4b5c-bc23-98dda681a85c]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:48 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:48 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:48 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:48 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:48 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:48 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:56:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.204s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Uploaded volume to glance image-id: d521437c-70ae-4e12-83ee-a1f474ab3d21. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.495s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a483d6-6544-4cf3-b12a-8e013701f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8090cc023e694e5ca7dfa683b8f895df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:56:47Z,use_quota=True,user_id='a7c2403121364ad49831f832ad25f2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Creating volume 70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:56:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:57 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1073741824 Sep 06 22:56:57 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-454e376a-33e7-4f48-a013-59d9f18a835c tempest-VolumesActionsTest-1562909690 None] Copy volume to image completed successfully. Sep 06 22:56:57 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1073741824" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:57 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 Sep 06 22:56:57 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:58 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Attempting download of 9cdfe306-7dd9-4219-9526-855c99804584 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}])) to volume 70a483d6-6544-4cf3-b12a-8e013701f666. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1060076f-e193-44e3-a828-9f1184ab2f1d]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:58 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a Sep 06 22:56:58 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:58 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:58 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a Sep 06 22:56:58 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:58 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a" returned: 1 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cdfe306-7dd9-4219-9526-855c99804584_4jr3_o5a' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b0fcf-5f54-4614-86ea-99e9168fc058]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:58 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:58 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:56:59 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7bc60-bf22-409e-bbdb-579c13f74ce7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD Sep 06 22:56:59 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:59 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] 9cdfe306-7dd9-4219-9526-855c99804584 was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 Sep 06 22:56:59 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c04b6ed-90e0-4818-9c07-ae3e277d7b7e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:56:59 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9cdfe306-7dd9-4219-9526-855c99804584_j6wdmg51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:56:59 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 22:56:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:56:59 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img Sep 06 22:56:59 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:56:59 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1G Sep 06 22:56:59 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:00 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 1G" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Downloaded image 9cdfe306-7dd9-4219-9526-855c99804584 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}])) to volume 70a483d6-6544-4cf3-b12a-8e013701f666 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Temporary image 9cdfe306-7dd9-4219-9526-855c99804584 for user a7c2403121364ad49831f832ad25f2df is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Marking volume 70a483d6-6544-4cf3-b12a-8e013701f666 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Copying metadata from image 9cdfe306-7dd9-4219-9526-855c99804584 to 70a483d6-6544-4cf3-b12a-8e013701f666. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Creating volume glance metadata for volume 70a483d6-6544-4cf3-b12a-8e013701f666 backed by image 9cdfe306-7dd9-4219-9526-855c99804584 with: {'image_id': '9cdfe306-7dd9-4219-9526-855c99804584', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8f111678aadbd6424ce24c8dece97f2a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dd73c9-5136-477c-bf4d-ac19c9dfedbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a483d6-6544-4cf3-b12a-8e013701f666', 'volume_size': 1, 'image_id': '9cdfe306-7dd9-4219-9526-855c99804584', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cdfe306-7dd9-4219-9526-855c99804584', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f111678aadbd6424ce24c8dece97f2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8090cc023e694e5ca7dfa683b8f895df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae834d51a9249885788f4f72f8bd92a929987d2e6ea9e9fdc30910dd4aaba8615a559bd59d3545383a5a9eb3a0e59373aa69d3a9d557d8315a05507bffe47eb6', 'id': '9cdfe306-7dd9-4219-9526-855c99804584', 'created_at': datetime.datetime(2026, 9, 6, 20, 56, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 56, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cdfe306-7dd9-4219-9526-855c99804584/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f0f35a-b868-4f26-af84-a005af3c61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Volume volume-70a483d6-6544-4cf3-b12a-8e013701f666 (70a483d6-6544-4cf3-b12a-8e013701f666): created successfully Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f0f35a-b868-4f26-af84-a005af3c61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Flow 'volume_create_manager' (5c899450-1747-488a-be5a-10fac368e174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e47915be-c7b2-464b-8108-fd466f5cb56a tempest-VolumeImageDependencyTests-600441307 None] Created volume successfully. Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Acquiring lock "cinder-70a483d6-6544-4cf3-b12a-8e013701f666-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "cinder-70a483d6-6544-4cf3-b12a-8e013701f666-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Acquiring lock "cinder-quobyte-70a483d6-6544-4cf3-b12a-8e013701f666" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "cinder-quobyte-70a483d6-6544-4cf3-b12a-8e013701f666" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5c87f-a05e-47f2-b494-aa607a8a4ade]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:01 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 Sep 06 22:57:01 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:02 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666" returned: 0 in 1.032s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:02 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666 Sep 06 22:57:02 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:02 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-70a483d6-6544-4cf3-b12a-8e013701f666" returned: 0 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "cinder-quobyte-70a483d6-6544-4cf3-b12a-8e013701f666" released by "delete_volume" :: held 1.604s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Created reservations ['b740bde7-f965-4ef0-af7a-5dd18c603207', '82f9a497-542f-4030-9a42-1c137801f769', '7c8b6398-bfa3-421d-9343-059a50a7a495', '7150a74e-8616-4cbe-9516-f2ea9224c9a3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:03 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:57:03 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:03 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:57:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Deleted volume successfully. Sep 06 22:57:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-06962c9a-08fe-4ba1-aedb-6f2e4fc4a88a tempest-VolumeImageDependencyTests-600441307 None] Lock "cinder-70a483d6-6544-4cf3-b12a-8e013701f666-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:04 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img" returned: 0 in 4.541s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf986e9-f41b-45e7-9450-c4e25f25a552]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:04 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:57:04 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:05 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:57:05 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Converted 1024.00 MB image at 225.43 MB/s Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] 002b99fd-f2a4-41e4-870d-e3a99eaad940 was raw, converting to qcow2 {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230d692-d4a2-45a1-9ebd-4fe1f4210ef3]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:05 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img Sep 06 22:57:05 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:05 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:05 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img Sep 06 22:57:05 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:05 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:57:05 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:05 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img" returned: 1 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:05 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe Sep 06 22:57:05 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:05 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:57:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:57:06 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe" returned: 0 in 0.309s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:06 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0c1f173-e42d-4087-a4fc-a9644b877040.temp_image.002b99fd-f2a4-41e4-870d-e3a99eaad940u7iy1umq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:57:06 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 06 22:57:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e7dee-640b-4338-90c9-47e641958401]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:06 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe Sep 06 22:57:06 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:06 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wiovzdpe" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.455s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Uploaded volume to glance image-id: 002b99fd-f2a4-41e4-870d-e3a99eaad940. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 22:57:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8072ae32-34b8-4690-be96-290e030ed84d tempest-VolumesActionsTest-1562909690 None] Copy volume to image completed successfully. Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Acquiring lock "cinder-quobyte-a0c1f173-e42d-4087-a4fc-a9644b877040" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-quobyte-a0c1f173-e42d-4087-a4fc-a9644b877040" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[104fdeb8-a12d-4a51-a384-180efde57f4e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:09 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:57:09 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:09 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:09 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040 Sep 06 22:57:09 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:09 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a0c1f173-e42d-4087-a4fc-a9644b877040" returned: 0 in 0.231s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-quobyte-a0c1f173-e42d-4087-a4fc-a9644b877040" released by "delete_volume" :: held 0.617s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Created reservations ['e156ca6f-a6b3-43e2-a319-02b14f104687', '6d533c0c-d9e7-4ed0-9339-f1358a9fa350', 'f33a40a1-e3ae-4390-8d9e-45f50264e58a', 'af926639-590f-4d0a-9c2e-4f3e75db2dc2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:10 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:57:10 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:10 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:57:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Deleted volume successfully. Sep 06 22:57:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5d4f6c3-de5c-4c01-bcee-1d49a69a0357 tempest-VolumesActionsTest-1562909690 None] Lock "cinder-a0c1f173-e42d-4087-a4fc-a9644b877040-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=54,cinder:UPDATE=62,cinder:DELETE=2,cinder:INSERT=20 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=49,cinder:SELECT=58,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Flow 'volume_create_manager' (ddbbaff7-9a1d-4ec1-8b35-4977431e5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75144da-215f-47a3-9284-52ea7fbde677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75144da-215f-47a3-9284-52ea7fbde677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1072947504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c0c7f-235e-4867-a6c0-a2d8226b3e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d60389bc0949128107469174c1d496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:17Z,use_quota=True,user_id='4f564e04ca4541be94fcb8c476f30cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387669aa-c4b2-46ac-be77-10d5ca020762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387669aa-c4b2-46ac-be77-10d5ca020762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dccfc11-1572-4d7f-a52f-134816a07371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dccfc11-1572-4d7f-a52f-134816a07371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645c0c7f-235e-4867-a6c0-a2d8226b3e8c', 'volume_name': 'volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec770f7-f6df-494d-b21f-d6118dc77988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec770f7-f6df-494d-b21f-d6118dc77988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762624f3-ecc6-4b6f-987c-181bda276459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Volume 645c0c7f-235e-4867-a6c0-a2d8226b3e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c', 'volume_size': 1} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1072947504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c0c7f-235e-4867-a6c0-a2d8226b3e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d60389bc0949128107469174c1d496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:17Z,use_quota=True,user_id='4f564e04ca4541be94fcb8c476f30cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Creating volume 645c0c7f-235e-4867-a6c0-a2d8226b3e8c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:57:17 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:17 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c 1073741824 Sep 06 22:57:17 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:17 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c 1073741824" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:17 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c Sep 06 22:57:17 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:17 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762624f3-ecc6-4b6f-987c-181bda276459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badc6173-b013-4cce-ad9d-73d986cc16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Volume volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c (645c0c7f-235e-4867-a6c0-a2d8226b3e8c): created successfully Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badc6173-b013-4cce-ad9d-73d986cc16f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Flow 'volume_create_manager' (ddbbaff7-9a1d-4ec1-8b35-4977431e5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a19f7fa5-66cb-4e0f-8f5b-e66e820ac400 tempest-VolumesNegativeTest-1075502091 None] Created volume successfully. Sep 06 22:57:27 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:27 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Acquiring lock "cinder-645c0c7f-235e-4867-a6c0-a2d8226b3e8c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "cinder-645c0c7f-235e-4867-a6c0-a2d8226b3e8c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Acquiring lock "cinder-quobyte-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "cinder-quobyte-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf51749-5967-42a5-b7b5-7d6b7ca1b188]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:33 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c Sep 06 22:57:33 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:33 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:33 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c Sep 06 22:57:33 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:33 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "cinder-quobyte-645c0c7f-235e-4867-a6c0-a2d8226b3e8c" released by "delete_volume" :: held 0.633s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Created reservations ['b93f2e45-4573-421a-93df-7d693f83f63e', '199dd27d-2e91-4a64-be7a-286501a4f5c9', '278acc8d-65cd-466c-acad-96f478bafb9a', 'f10c062a-82a7-43f6-bc79-44a4acab114a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:33 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:57:33 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:34 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:34 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:57:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Deleted volume successfully. Sep 06 22:57:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-187fbc47-3599-4dcc-8253-bc0420e3d5c7 tempest-VolumesNegativeTest-1075502091 None] Lock "cinder-645c0c7f-235e-4867-a6c0-a2d8226b3e8c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:43 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:44 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (fe46570d-1494-4889-9a8c-b27e674ef90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0963923d-d006-43c8-8014-fb70c83c5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0963923d-d006-43c8-8014-fb70c83c5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336699729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0affe-ba21-41d9-9df2-61c7449cddde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:47Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79587ecb-7147-4627-932e-6a219ba31da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79587ecb-7147-4627-932e-6a219ba31da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb021863-0beb-4048-839b-c5e9d5adddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb021863-0beb-4048-839b-c5e9d5adddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea0affe-ba21-41d9-9df2-61c7449cddde', 'volume_name': 'volume-eea0affe-ba21-41d9-9df2-61c7449cddde', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f387855-cf31-487f-a346-7dc8c9d514ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f387855-cf31-487f-a346-7dc8c9d514ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188e8e9e-4c3d-4705-8a2a-949113df4571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume eea0affe-ba21-41d9-9df2-61c7449cddde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea0affe-ba21-41d9-9df2-61c7449cddde', 'volume_size': 1} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336699729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0affe-ba21-41d9-9df2-61c7449cddde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:47Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating volume eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:57:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:47 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde 1073741824 Sep 06 22:57:47 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:47 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde 1073741824" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:47 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde Sep 06 22:57:47 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:47 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188e8e9e-4c3d-4705-8a2a-949113df4571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea0affe-ba21-41d9-9df2-61c7449cddde', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e355c1-525d-4f50-9966-a6e1bac0b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume volume-eea0affe-ba21-41d9-9df2-61c7449cddde (eea0affe-ba21-41d9-9df2-61c7449cddde): created successfully Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e355c1-525d-4f50-9966-a6e1bac0b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (fe46570d-1494-4889-9a8c-b27e674ef90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-46da7d11-042f-4695-b5d3-aec13c307eb3 tempest-VolumesSnapshotTestJSON-1463977562 None] Created volume successfully. Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating offline snapshot 5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 of volume eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b8d1d-b357-44e0-a879-45d8f16a3a9d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:48 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde Sep 06 22:57:48 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:48 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:48 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 1G Sep 06 22:57:48 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:49 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 1G" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0affe-ba21-41d9-9df2-61c7449cddde -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:49 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0affe-ba21-41d9-9df2-61c7449cddde -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 Sep 06 22:57:49 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:49 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0affe-ba21-41d9-9df2-61c7449cddde -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 is being set with open permissions: ugo+rw Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:49 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 Sep 06 22:57:49 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:49 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:49 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info Sep 06 22:57:49 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:49 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info is being set with open permissions: ugo+rw Sep 06 22:57:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:49 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info Sep 06 22:57:49 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:50 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.info" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-01ece13f-87e8-48b8-97bc-e7c82b3f4845 tempest-VolumesSnapshotTestJSON-1463977562 None] Create snapshot completed successfully Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Deleting offline snapshot 5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 of volume eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] snapshot_file for this snap is: volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54aca50-d04f-44b9-b442-cda54dccc2f1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:50 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 Sep 06 22:57:50 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:51 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea0affe-ba21-41d9-9df2-61c7449cddde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb1c26-0256-4f4a-829d-030c8d30a1f5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:51 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde Sep 06 22:57:51 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:51 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:51 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 Sep 06 22:57:51 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:51 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" returned: 0 in 0.332s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:51 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9 Sep 06 22:57:51 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:51 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde.5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9" released by "_delete_snapshot" :: held 1.346s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" released by "delete_snapshot" :: held 1.370s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:52 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['a283cbe5-b685-44fd-b638-161c7cafb5a2', 'd6194d77-f570-4a07-aeb5-0e2e9a9813fa', '792214f9-667b-40b6-9771-0c06f3f75242', '8a933504-14b1-4803-9021-b89092086d05'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:57:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Delete snapshot completed successfully. Sep 06 22:57:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-09b4ea84-49d2-4845-ab0e-272d869a36ae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-5230b1a4-6e84-4faf-b29a-0c378bd4bbe9-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (1eefd86b-ec66-4c21-9f48-6f2eca91b731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db040e4-6794-439b-9295-ccef04445f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db040e4-6794-439b-9295-ccef04445f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2019301220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10362070-5902-46bf-9229-1491dfa3b3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:53Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7648c748-2009-4d9f-95d6-8c826330605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7648c748-2009-4d9f-95d6-8c826330605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e615c14-0f61-4869-a434-5fc64abc4a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e615c14-0f61-4869-a434-5fc64abc4a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10362070-5902-46bf-9229-1491dfa3b3ec', 'volume_name': 'volume-10362070-5902-46bf-9229-1491dfa3b3ec', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2440e7c4-2487-4f56-82bb-ede469f484a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2440e7c4-2487-4f56-82bb-ede469f484a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4931327b-1df8-4819-955d-a6dbfab15a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume 10362070-5902-46bf-9229-1491dfa3b3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10362070-5902-46bf-9229-1491dfa3b3ec', 'volume_size': 1} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2019301220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10362070-5902-46bf-9229-1491dfa3b3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:53Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating volume 10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:57:53 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:53 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec 1073741824 Sep 06 22:57:53 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:53 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec 1073741824" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:53 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:57:53 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:53 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:57:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4931327b-1df8-4819-955d-a6dbfab15a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10362070-5902-46bf-9229-1491dfa3b3ec', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d1ba59-e29a-46a2-bbaa-005a6081ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume volume-10362070-5902-46bf-9229-1491dfa3b3ec (10362070-5902-46bf-9229-1491dfa3b3ec): created successfully Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d1ba59-e29a-46a2-bbaa-005a6081ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (1eefd86b-ec66-4c21-9f48-6f2eca91b731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f8180318-652c-41ee-851d-b4f299b3b3c8 tempest-VolumesSnapshotTestJSON-1463977562 None] Created volume successfully. Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating offline snapshot 8bdc4cc9-2a13-41c4-b143-8b776dea4c2e of volume 10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3c3ad-a401-422a-a92e-fdb39d666a2b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:54 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:57:54 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:54 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:54 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e 1G Sep 06 22:57:54 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:55 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e 1G" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10362070-5902-46bf-9229-1491dfa3b3ec -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:55 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10362070-5902-46bf-9229-1491dfa3b3ec -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:57:55 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:55 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10362070-5902-46bf-9229-1491dfa3b3ec -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e is being set with open permissions: ugo+rw Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:55 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:57:55 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:55 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:55 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info Sep 06 22:57:55 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:55 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info is being set with open permissions: ugo+rw Sep 06 22:57:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:55 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info Sep 06 22:57:55 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:56 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.info" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b1e01d3d-0edd-4e4c-89f5-4fcb504211f8 tempest-VolumesSnapshotTestJSON-1463977562 None] Create snapshot completed successfully Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (255e1025-d3ed-4cf3-807f-ba2bb41839cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a2ddc-1146-48ba-a077-42b8426ab0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a2ddc-1146-48ba-a077-42b8426ab0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817914013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a35877-7d8a-43cc-896f-c89c57736d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:57:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8bdc4cc9-2a13-41c4-b143-8b776dea4c2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:57:57Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66a9ab-45c0-48b8-a524-b8480e67de84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66a9ab-45c0-48b8-a524-b8480e67de84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0612233-0821-4288-bed5-c3c8223ae18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0612233-0821-4288-bed5-c3c8223ae18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7a35877-7d8a-43cc-896f-c89c57736d7f', 'volume_name': 'volume-a7a35877-7d8a-43cc-896f-c89c57736d7f', 'volume_size': 2, 'snapshot_id': '8bdc4cc9-2a13-41c4-b143-8b776dea4c2e'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e82372b-900d-4549-b569-57e925a52c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e82372b-900d-4549-b569-57e925a52c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a360403-99d1-4613-94fc-1d11464c8b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:57:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume a7a35877-7d8a-43cc-896f-c89c57736d7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7a35877-7d8a-43cc-896f-c89c57736d7f', 'volume_size': 2, 'snapshot_id': '8bdc4cc9-2a13-41c4-b143-8b776dea4c2e'} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-a7a35877-7d8a-43cc-896f-c89c57736d7f" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-a7a35877-7d8a-43cc-896f-c89c57736d7f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating volume a7a35877-7d8a-43cc-896f-c89c57736d7f from snapshot 8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] snapshot: 8bdc4cc9-2a13-41c4-b143-8b776dea4c2e, volume: a7a35877-7d8a-43cc-896f-c89c57736d7f, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d95fd-81c1-4e88-befb-a55f17669073]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:57 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:57:57 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:57 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10362070-5902-46bf-9229-1491dfa3b3ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b556fed-f750-45a7-8350-323cbec29479]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:57 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:57:57 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:57:57 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:57:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:57:57 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f Sep 06 22:57:57 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:01 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f" returned: 0 in 3.978s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:01 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:58:01 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Converted 1024.00 MB image at 257.33 MB/s Sep 06 22:58:01 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f is being set with open permissions: ugo+rw Sep 06 22:58:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:01 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f Sep 06 22:58:01 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:02 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" released by "_copy_volume_from_snapshot" :: held 4.987s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-a7a35877-7d8a-43cc-896f-c89c57736d7f" released by "_create_volume_from_snapshot" :: held 5.047s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.061s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a360403-99d1-4613-94fc-1d11464c8b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a35877-7d8a-43cc-896f-c89c57736d7f', 'volume_size': 2, 'snapshot_id': '8bdc4cc9-2a13-41c4-b143-8b776dea4c2e'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908dc9dd-2c5a-49fb-bdef-4146d2a993d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Volume volume-a7a35877-7d8a-43cc-896f-c89c57736d7f (a7a35877-7d8a-43cc-896f-c89c57736d7f): created successfully Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908dc9dd-2c5a-49fb-bdef-4146d2a993d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (255e1025-d3ed-4cf3-807f-ba2bb41839cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e4330ac7-43f8-4d94-81a2-bb907037c767 tempest-VolumesSnapshotTestJSON-1463977562 None] Created volume successfully. Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-a7a35877-7d8a-43cc-896f-c89c57736d7f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-a7a35877-7d8a-43cc-896f-c89c57736d7f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b3836-8acd-4281-b896-fc16e6011280]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:02 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f Sep 06 22:58:02 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:02 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:02 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f Sep 06 22:58:02 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:03 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a7a35877-7d8a-43cc-896f-c89c57736d7f" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-a7a35877-7d8a-43cc-896f-c89c57736d7f" released by "delete_volume" :: held 0.628s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['5354db7b-d62d-485c-9a44-574c49a524da', 'b4a2772b-a65e-409a-9349-01a7c38156f9', '0d71df20-acbf-4a1b-8062-d8ded60111bb', 'a2017301-c707-4390-8c1f-fd60b6417b29'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:03 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:03 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:03 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Deleted volume successfully. Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-23b0622a-27bc-40ae-9e32-cc22300a4bd5 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-a7a35877-7d8a-43cc-896f-c89c57736d7f-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Deleting offline snapshot 8bdc4cc9-2a13-41c4-b143-8b776dea4c2e of volume 10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] snapshot_file for this snap is: volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c3541-d9a1-41a5-b5cb-45087c5d3272]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:03 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:58:03 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:04 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10362070-5902-46bf-9229-1491dfa3b3ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc63911-19cd-4a55-9b3b-50347dd3e849]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:04 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:58:04 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:04 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:04 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:58:04 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:04 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:04 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e Sep 06 22:58:04 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:05 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec.8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e" released by "_delete_snapshot" :: held 1.526s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" released by "delete_snapshot" :: held 1.553s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['f92251a8-e473-40eb-99ae-a1563039c3ab', '9952f2e0-9e74-4cad-8301-e74ce896f457', 'b8b7c279-14d2-4b3d-8c51-602044356921', '8eb03a7e-1d51-40bf-b021-49fe6b8f7d0c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Delete snapshot completed successfully. Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7178b634-3b4a-4b15-b05f-4c3a87e64858 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-8bdc4cc9-2a13-41c4-b143-8b776dea4c2e-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:05 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:05 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-10362070-5902-46bf-9229-1491dfa3b3ec-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-10362070-5902-46bf-9229-1491dfa3b3ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:05 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa49de-ca23-45a9-b511-9de6b034937d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:06 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:58:06 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:06 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:06 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec Sep 06 22:58:06 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:06 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-10362070-5902-46bf-9229-1491dfa3b3ec" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-10362070-5902-46bf-9229-1491dfa3b3ec" released by "delete_volume" :: held 0.654s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['b77db96d-359a-4583-9d1e-36a6b1487451', '571ec559-6acb-48f1-bfa0-059d514edc86', '75f12e3a-5558-43eb-bc95-a48bc8e7ad1c', '5a1ef471-240f-4743-a1d2-d5388cda1e31'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:06 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:06 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:06 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Deleted volume successfully. Sep 06 22:58:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44473916-0771-4ff8-9abd-13e14053c2d0 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-10362070-5902-46bf-9229-1491dfa3b3ec-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (b5ac2848-f3ac-44ff-a414-6d5dc73bdfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd7b8be-398b-4d60-af4c-cc1826e7a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd7b8be-398b-4d60-af4c-cc1826e7a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1153424387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632ea668-7e53-41eb-86c4-17ecfe8d9338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:07Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f59e19-02d6-43a6-a57e-90f8cf324856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f59e19-02d6-43a6-a57e-90f8cf324856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71c278b-1f71-4ded-afca-8679c81f50c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71c278b-1f71-4ded-afca-8679c81f50c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632ea668-7e53-41eb-86c4-17ecfe8d9338', 'volume_name': 'volume-632ea668-7e53-41eb-86c4-17ecfe8d9338', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aff8685-0b4e-496b-a014-9d547a1b8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aff8685-0b4e-496b-a014-9d547a1b8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51215b0-d916-47e8-b406-e6ee7ebbeef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:07 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Volume 632ea668-7e53-41eb-86c4-17ecfe8d9338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632ea668-7e53-41eb-86c4-17ecfe8d9338', 'volume_size': 1} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1153424387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632ea668-7e53-41eb-86c4-17ecfe8d9338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:07Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Creating volume 632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:58:07 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:07 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 1073741824 Sep 06 22:58:07 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:07 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 1073741824" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:07 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:07 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:08 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51215b0-d916-47e8-b406-e6ee7ebbeef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632ea668-7e53-41eb-86c4-17ecfe8d9338', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc906323-91af-4f3d-ae76-92e6aef1e2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Volume volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 (632ea668-7e53-41eb-86c4-17ecfe8d9338): created successfully Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc906323-91af-4f3d-ae76-92e6aef1e2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (b5ac2848-f3ac-44ff-a414-6d5dc73bdfe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-38e339fc-6f95-416a-be72-7a064e7dbdae tempest-VolumesSnapshotTestJSON-1463977562 None] Created volume successfully. Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Creating offline snapshot 604a58e1-44ca-4ea1-8a30-db8cb017a9b8 of volume 632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339b99b-61e0-4fe3-8ad5-a09f6cb223f5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:08 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:08 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:08 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:08 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 1G Sep 06 22:58:08 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:09 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 1G" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:09 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:09 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:09 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:09 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 is being set with open permissions: ugo+rw Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:09 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:09 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:09 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.229s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:09 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info Sep 06 22:58:09 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:10 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:10 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info is being set with open permissions: ugo+rw Sep 06 22:58:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:10 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info Sep 06 22:58:10 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:10 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.info" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-09f257c6-2c4e-4c97-a3e4-ee98b90ea547 tempest-VolumesSnapshotTestJSON-1463977562 None] Create snapshot completed successfully Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (ef13501a-9109-48fb-94fd-bd141c55f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9566d5f-ec34-41a5-9203-1b24b3baad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9566d5f-ec34-41a5-9203-1b24b3baad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-921972565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498873bf-f144-45bd-882f-660b5ed04795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73dee474f6dc41119ed8667030bf0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=604a58e1-44ca-4ea1-8a30-db8cb017a9b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:11Z,use_quota=True,user_id='7c8abc5fde66434bb6768dce947dc4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b1c5d1-f260-4908-b4db-36bcbbb71a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b1c5d1-f260-4908-b4db-36bcbbb71a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97ed6d-76a6-4a09-8ad1-2efe193d1f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97ed6d-76a6-4a09-8ad1-2efe193d1f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '498873bf-f144-45bd-882f-660b5ed04795', 'volume_name': 'volume-498873bf-f144-45bd-882f-660b5ed04795', 'volume_size': 1, 'snapshot_id': '604a58e1-44ca-4ea1-8a30-db8cb017a9b8'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf926f27-ee9f-4455-9445-e8999f8a7f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf926f27-ee9f-4455-9445-e8999f8a7f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a288bc29-42a6-4056-bdca-37248c6543ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Volume 498873bf-f144-45bd-882f-660b5ed04795: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-498873bf-f144-45bd-882f-660b5ed04795', 'volume_size': 1, 'snapshot_id': '604a58e1-44ca-4ea1-8a30-db8cb017a9b8'} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-498873bf-f144-45bd-882f-660b5ed04795" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-498873bf-f144-45bd-882f-660b5ed04795" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Creating volume 498873bf-f144-45bd-882f-660b5ed04795 from snapshot 604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] snapshot: 604a58e1-44ca-4ea1-8a30-db8cb017a9b8, volume: 498873bf-f144-45bd-882f-660b5ed04795, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f8a34-dc09-4c8e-adcc-317e4025b3e7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:11 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:11 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:11 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632ea668-7e53-41eb-86c4-17ecfe8d9338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f8f53-9eea-44fb-9434-2fc394826149]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:11 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:11 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:12 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 22:58:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 22:58:12 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 22:58:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:12 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 Sep 06 22:58:12 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:15 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795" returned: 0 in 3.919s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:15 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:58:15 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Converted 1024.00 MB image at 261.17 MB/s Sep 06 22:58:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 is being set with open permissions: ugo+rw Sep 06 22:58:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:15 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 Sep 06 22:58:15 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:16 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" released by "_copy_volume_from_snapshot" :: held 4.917s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-498873bf-f144-45bd-882f-660b5ed04795" released by "_create_volume_from_snapshot" :: held 4.972s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.992s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a288bc29-42a6-4056-bdca-37248c6543ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498873bf-f144-45bd-882f-660b5ed04795', 'volume_size': 1, 'snapshot_id': '604a58e1-44ca-4ea1-8a30-db8cb017a9b8'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e88c1c-9553-42cb-90d4-c3bc0cf3d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Volume volume-498873bf-f144-45bd-882f-660b5ed04795 (498873bf-f144-45bd-882f-660b5ed04795): created successfully Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e88c1c-9553-42cb-90d4-c3bc0cf3d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Flow 'volume_create_manager' (ef13501a-9109-48fb-94fd-bd141c55f039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fd8144f5-1aad-4119-a7ea-6686b75776aa tempest-VolumesSnapshotTestJSON-1463977562 None] Created volume successfully. Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-498873bf-f144-45bd-882f-660b5ed04795-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-498873bf-f144-45bd-882f-660b5ed04795-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" acquired by "delete_volume" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86b329-0df5-48cc-a7e3-3d9f9f2c888c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:16 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 Sep 06 22:58:16 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:17 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:17 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795 Sep 06 22:58:17 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:17 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-498873bf-f144-45bd-882f-660b5ed04795" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-498873bf-f144-45bd-882f-660b5ed04795" released by "delete_volume" :: held 0.619s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['7bfcc772-571d-4f6a-961b-cddabcb1edaa', '61e67754-99b9-4128-9663-4d243fb70778', '1a49efc1-a895-4368-8c8e-670b6ace3f10', '021f58ab-27d2-419b-842e-e5e3a4c044f6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:17 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:17 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:17 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Deleted volume successfully. Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24e58715-470b-45a1-aa43-ba3d7b5bd3d2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-498873bf-f144-45bd-882f-660b5ed04795-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Deleting offline snapshot 604a58e1-44ca-4ea1-8a30-db8cb017a9b8 of volume 632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:58:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] snapshot_file for this snap is: volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b674b-f53b-437a-b475-9201c46d5f1a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:18 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:18 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:18 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.341s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632ea668-7e53-41eb-86c4-17ecfe8d9338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5810c66-d08f-4871-90c4-c4ae0d7efbfe]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:18 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:18 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:18 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.513s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:18 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:18 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:19 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:19 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8 Sep 06 22:58:19 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:19 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338.604a58e1-44ca-4ea1-8a30-db8cb017a9b8" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-604a58e1-44ca-4ea1-8a30-db8cb017a9b8" released by "_delete_snapshot" :: held 1.502s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" released by "delete_snapshot" :: held 1.522s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['da1f97f3-2970-4656-b084-4a658825e380', 'e0a8fd19-1ec1-4604-9949-99d259034d28', '35544d56-b646-4a7f-a9b4-cc4ebb787d4e', 'b5d375cf-8d3c-4e25-a800-232dfd6910f2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Delete snapshot completed successfully. Sep 06 22:58:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ba3bc4a2-5686-4d56-96bf-6561ca30fad2 tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-604a58e1-44ca-4ea1-8a30-db8cb017a9b8-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-632ea668-7e53-41eb-86c4-17ecfe8d9338-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-632ea668-7e53-41eb-86c4-17ecfe8d9338-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8e53e-f152-40fa-9d64-804a2ca27bfb]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:20 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:20 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:20 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:20 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338 Sep 06 22:58:20 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:20 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-632ea668-7e53-41eb-86c4-17ecfe8d9338" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-632ea668-7e53-41eb-86c4-17ecfe8d9338" released by "delete_volume" :: held 0.647s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['41fe3a74-9fcc-4338-be14-f474bd306173', 'b03e2657-009a-4f2b-8a48-3111ba4934ce', '97c62243-c290-4825-880a-db85801b73f8', '32d3d757-de99-4674-bff6-af26cced70d3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:20 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:20 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:21 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Deleted volume successfully. Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8277e49e-99b0-4d36-b7e0-0f648790855f tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-632ea668-7e53-41eb-86c4-17ecfe8d9338-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-eea0affe-ba21-41d9-9df2-61c7449cddde-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-eea0affe-ba21-41d9-9df2-61c7449cddde-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5605c2b-3c7b-4425-aa04-146fb55dc59c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:21 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde Sep 06 22:58:21 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:21 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:21 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde Sep 06 22:58:21 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:22 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-eea0affe-ba21-41d9-9df2-61c7449cddde" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-quobyte-eea0affe-ba21-41d9-9df2-61c7449cddde" released by "delete_volume" :: held 0.639s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Created reservations ['efe31a3c-ff7c-4412-b828-8c0fdf941604', 'da950076-3e80-45ba-a846-31943e4ef65a', '10f415e6-06c9-48a5-a36d-ed778df87b2b', '12572808-2fc7-45ec-8768-494ff5df9b23'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:22 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:22 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:22 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Deleted volume successfully. Sep 06 22:58:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4d289e79-4994-453b-8af5-49db40d16bab tempest-VolumesSnapshotTestJSON-1463977562 None] Lock "cinder-eea0affe-ba21-41d9-9df2-61c7449cddde-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Flow 'volume_create_manager' (f261eb57-b4f8-4ecd-9b05-65691bbcb116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b789ae-a6eb-439c-b154-af09253ee4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b789ae-a6eb-439c-b154-af09253ee4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1506489075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486a091-be45-4f36-854d-75b74b0f143b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae39a7ab8b8401b8e075a8f4b35d0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:29Z,use_quota=True,user_id='ea0e9fc7c3bd4d6ab0dd4ec830237dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbe4c42-c448-47a2-9427-dc2b2a0bd047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbe4c42-c448-47a2-9427-dc2b2a0bd047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060ee3af-1329-4818-a175-ff8dc47b239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060ee3af-1329-4818-a175-ff8dc47b239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8486a091-be45-4f36-854d-75b74b0f143b', 'volume_name': 'volume-8486a091-be45-4f36-854d-75b74b0f143b', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413983ce-c725-4700-b5ec-b05b1cd7a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413983ce-c725-4700-b5ec-b05b1cd7a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00193a9-5b38-4a92-b3ef-8d6af81277ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Volume 8486a091-be45-4f36-854d-75b74b0f143b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8486a091-be45-4f36-854d-75b74b0f143b', 'volume_size': 2} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1506489075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486a091-be45-4f36-854d-75b74b0f143b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae39a7ab8b8401b8e075a8f4b35d0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:29Z,use_quota=True,user_id='ea0e9fc7c3bd4d6ab0dd4ec830237dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Creating volume 8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:58:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b 2147483648 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:29 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b 2147483648 Sep 06 22:58:29 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:29 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b 2147483648" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:29 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b Sep 06 22:58:29 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:30 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00193a9-5b38-4a92-b3ef-8d6af81277ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8486a091-be45-4f36-854d-75b74b0f143b', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1767814-6860-45a4-9e96-d5ae5ad12ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Volume volume-8486a091-be45-4f36-854d-75b74b0f143b (8486a091-be45-4f36-854d-75b74b0f143b): created successfully Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1767814-6860-45a4-9e96-d5ae5ad12ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Flow 'volume_create_manager' (f261eb57-b4f8-4ecd-9b05-65691bbcb116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a998c865-c9af-4e1b-8f05-ffaeab35b1cd tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Created volume successfully. Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Creating offline snapshot abe210fa-7d2b-45b0-8d1b-780ae6f931c4 of volume 8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[805be90a-414b-4e5f-a7c0-d34fc073740b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:30 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b Sep 06 22:58:30 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:30 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:30 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 2G Sep 06 22:58:30 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:31 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 2G" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8486a091-be45-4f36-854d-75b74b0f143b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:31 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8486a091-be45-4f36-854d-75b74b0f143b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 Sep 06 22:58:31 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:31 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8486a091-be45-4f36-854d-75b74b0f143b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 is being set with open permissions: ugo+rw Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:31 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 Sep 06 22:58:31 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:31 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4" returned: 0 in 0.229s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:31 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info Sep 06 22:58:31 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:31 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info is being set with open permissions: ugo+rw Sep 06 22:58:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:32 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info Sep 06 22:58:32 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:32 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.info" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-756d0904-308a-430b-aa0e-d29ca9214809 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Create snapshot completed successfully Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "cinder-abe210fa-7d2b-45b0-8d1b-780ae6f931c4-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-abe210fa-7d2b-45b0-8d1b-780ae6f931c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "cinder-quobyte-abe210fa-7d2b-45b0-8d1b-780ae6f931c4" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-abe210fa-7d2b-45b0-8d1b-780ae6f931c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Deleting offline snapshot abe210fa-7d2b-45b0-8d1b-780ae6f931c4 of volume 8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] snapshot_file for this snap is: volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa15e61-d237-4069-8b11-4468e12dd4a7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:32 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 Sep 06 22:58:32 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:33 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8486a091-be45-4f36-854d-75b74b0f143b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d4d1a3-95ad-4726-8ea7-23a5371196db]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:33 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b Sep 06 22:58:33 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:33 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:33 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 Sep 06 22:58:33 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:33 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:33 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4 Sep 06 22:58:33 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:34 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b.abe210fa-7d2b-45b0-8d1b-780ae6f931c4" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-abe210fa-7d2b-45b0-8d1b-780ae6f931c4" released by "_delete_snapshot" :: held 1.369s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" released by "delete_snapshot" :: held 1.399s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Created reservations ['80b7d4cf-9687-47bd-90e5-e5d968f129ed', 'bed195e3-3b30-4a4d-962e-217ee39c69d7', 'ec3f86b9-51a0-44cc-b06b-a40dee44481b', 'ba581bf9-26dc-41ed-aadc-7936f63967cb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Delete snapshot completed successfully. Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-99c78c8a-0bf4-4420-89ed-a137e238b0d4 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-abe210fa-7d2b-45b0-8d1b-780ae6f931c4-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "cinder-8486a091-be45-4f36-854d-75b74b0f143b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-8486a091-be45-4f36-854d-75b74b0f143b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7808ed4-5bcd-4106-839d-7cb475d3528a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:58:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:35 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b Sep 06 22:58:35 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:35 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:35 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b Sep 06 22:58:35 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:35 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8486a091-be45-4f36-854d-75b74b0f143b" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-quobyte-8486a091-be45-4f36-854d-75b74b0f143b" released by "delete_volume" :: held 0.639s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Created reservations ['6ad932e0-5b2a-493f-8c70-e2bca304c669', '289ba6ae-7e87-48a7-b3f6-103763636929', 'fc769b50-d3dc-4b47-9174-5f297f80ee04', '44c764b8-76de-465a-ba87-a37df04c7f8c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:35 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:58:35 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:35 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:58:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Deleted volume successfully. Sep 06 22:58:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-45948970-9493-45ad-a86d-0b9a95038313 tempest-VolumesSnapshotNegativeTestJSON-1945009029 None] Lock "cinder-8486a091-be45-4f36-854d-75b74b0f143b-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:58:45 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=84,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:58:45 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=91,cinder:UPDATE=96,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (cd7ef34d-a3fa-46dc-a66a-5ddcbb3facfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85656c4-a19a-4928-b15a-acf0b2a6cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85656c4-a19a-4928-b15a-acf0b2a6cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2100355413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd6d63a-c134-445a-a1a8-41c2992f7958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:59Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03137ba5-ae88-4619-a821-862292b0e010),volume_type_id=03137ba5-ae88-4619-a821-862292b0e010)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a5ebf5-4e9a-47ac-ab2b-afbdfb59d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a5ebf5-4e9a-47ac-ab2b-afbdfb59d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7563b34e-89ac-4fb1-8053-d2d121ef0e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7563b34e-89ac-4fb1-8053-d2d121ef0e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd6d63a-c134-445a-a1a8-41c2992f7958', 'volume_name': 'volume-9bd6d63a-c134-445a-a1a8-41c2992f7958', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70cc104-70db-4a5e-8573-fb55ab0e9e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70cc104-70db-4a5e-8573-fb55ab0e9e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d080d17-7a0d-4e73-8d6c-f2755ce5b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume 9bd6d63a-c134-445a-a1a8-41c2992f7958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd6d63a-c134-445a-a1a8-41c2992f7958', 'volume_size': 1} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2100355413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd6d63a-c134-445a-a1a8-41c2992f7958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:59Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03137ba5-ae88-4619-a821-862292b0e010),volume_type_id=03137ba5-ae88-4619-a821-862292b0e010)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Creating volume 9bd6d63a-c134-445a-a1a8-41c2992f7958 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:58:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:58:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:58 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 1073741824 Sep 06 22:58:58 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (93fc558a-3547-471f-84e4-de881cd4e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245b0a7-d66e-4e62-8c4d-cfb398786e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245b0a7-d66e-4e62-8c4d-cfb398786e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2115790479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b9f5db-fdf4-4af0-8705-777348120af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:59Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca71bff9-bc83-493f-a23c-bad879339781),volume_type_id=ca71bff9-bc83-493f-a23c-bad879339781)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad19389-9567-4919-b460-b2e1f352887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad19389-9567-4919-b460-b2e1f352887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbbd370-964f-489c-8477-2341d94aef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbbd370-964f-489c-8477-2341d94aef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b9f5db-fdf4-4af0-8705-777348120af3', 'volume_name': 'volume-99b9f5db-fdf4-4af0-8705-777348120af3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b12e08-38a2-4996-b3ba-9f17e3b99c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b12e08-38a2-4996-b3ba-9f17e3b99c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6943f1-599a-46f4-a1f4-328725aba903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume 99b9f5db-fdf4-4af0-8705-777348120af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b9f5db-fdf4-4af0-8705-777348120af3', 'volume_size': 1} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:59 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 1073741824" returned: 0 in 0.461s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:59 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 Sep 06 22:58:59 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:59 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2115790479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b9f5db-fdf4-4af0-8705-777348120af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:58:59Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca71bff9-bc83-493f-a23c-bad879339781),volume_type_id=ca71bff9-bc83-493f-a23c-bad879339781)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Creating volume 99b9f5db-fdf4-4af0-8705-777348120af3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:58:59 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:58:59 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 1073741824 Sep 06 22:58:59 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d080d17-7a0d-4e73-8d6c-f2755ce5b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd6d63a-c134-445a-a1a8-41c2992f7958', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20288bf-7fe0-4026-a516-663fc6505a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 (9bd6d63a-c134-445a-a1a8-41c2992f7958): created successfully Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20288bf-7fe0-4026-a516-663fc6505a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (cd7ef34d-a3fa-46dc-a66a-5ddcbb3facfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (b1978192-a4a9-46c4-a05b-6facfffb45e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb27bdc8-7c5e-4313-ba98-9b2be1e0c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb27bdc8-7c5e-4313-ba98-9b2be1e0c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2046913322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38076dd3-de45-49a1-afbf-42563c1e29e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:59:00Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbee555a-d062-4d26-9c96-5c459baa26b4),volume_type_id=bbee555a-d062-4d26-9c96-5c459baa26b4)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c77b175-94d6-4643-85e5-4831fa3262ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c77b175-94d6-4643-85e5-4831fa3262ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8304eb5a-291c-48db-9564-bf6c8763f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 22:58:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1f14032f-1722-4d79-9f3b-90e80b743193 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created volume successfully. Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8304eb5a-291c-48db-9564-bf6c8763f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38076dd3-de45-49a1-afbf-42563c1e29e2', 'volume_name': 'volume-38076dd3-de45-49a1-afbf-42563c1e29e2', 'volume_size': 1, 'image_id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439828985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54d6ee61dcaf4dd48fba3afc4b18c474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'created_at': datetime.datetime(2026, 9, 6, 20, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 58, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2db32dee-6634-4f8d-a813-9c1e8917e986/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dca0b-72cc-4b61-8a38-aa3403ce6bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dca0b-72cc-4b61-8a38-aa3403ce6bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b9f1f2-9c1c-4f13-97e8-377fda2ef85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:58:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume 38076dd3-de45-49a1-afbf-42563c1e29e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38076dd3-de45-49a1-afbf-42563c1e29e2', 'volume_size': 1, 'image_id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439828985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54d6ee61dcaf4dd48fba3afc4b18c474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'created_at': datetime.datetime(2026, 9, 6, 20, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 58, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2db32dee-6634-4f8d-a813-9c1e8917e986/file', 'properties': {}}, 'image_service': } Sep 06 22:58:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Trying to clone 38076dd3-de45-49a1-afbf-42563c1e29e2 from image 2db32dee-6634-4f8d-a813-9c1e8917e986 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 22:58:59 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 1073741824" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:00 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 Sep 06 22:59:00 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:00 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6943f1-599a-46f4-a1f4-328725aba903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b9f5db-fdf4-4af0-8705-777348120af3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05302ec-6739-4633-9161-826238e90e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:59:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume volume-99b9f5db-fdf4-4af0-8705-777348120af3 (99b9f5db-fdf4-4af0-8705-777348120af3): created successfully Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05302ec-6739-4633-9161-826238e90e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:59:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (93fc558a-3547-471f-84e4-de881cd4e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:59:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12021330-fa95-45f2-9bf4-417792c65d16 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created volume successfully. Sep 06 22:59:02 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD, size 20.69 MB, duration 2.80 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 22:59:02 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Image download 20.69 MB at 7.40 MB/s Sep 06 22:59:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d7b7a-df2f-4cff-835a-3aad0977f1f7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:02 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD Sep 06 22:59:02 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:03 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Temporary image 2db32dee-6634-4f8d-a813-9c1e8917e986 is fetched for user 06786b8354a14e6da2d79da23651b859. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8189f2-190b-466b-8688-7c5e7286bae2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:03 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD Sep 06 22:59:03 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:03 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T20:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2046913322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38076dd3-de45-49a1-afbf-42563c1e29e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ee61dcaf4dd48fba3afc4b18c474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T20:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T20:59:00Z,use_quota=True,user_id='06786b8354a14e6da2d79da23651b859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbee555a-d062-4d26-9c96-5c459baa26b4),volume_type_id=bbee555a-d062-4d26-9c96-5c459baa26b4)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Creating volume 38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 22:59:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:03 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1073741824 Sep 06 22:59:03 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:03 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1073741824" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:04 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 Sep 06 22:59:04 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:04 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Attempting download of 2db32dee-6634-4f8d-a813-9c1e8917e986 ((None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}])) to volume 38076dd3-de45-49a1-afbf-42563c1e29e2. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd796e6a-bc17-42d1-8805-c3f0abfd5a86]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_ {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:04 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_ Sep 06 22:59:04 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:04 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_ {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:04 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_ Sep 06 22:59:04 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:04 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_" returned: 1 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2db32dee-6634-4f8d-a813-9c1e8917e986_wck_ktd_' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef8d15-2f0c-4177-99d6-eaec2c65da35]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:05 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD Sep 06 22:59:05 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:05 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] 2db32dee-6634-4f8d-a813-9c1e8917e986 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:05 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 Sep 06 22:59:05 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:05 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:59:05 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:05 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 22:59:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 22:59:06 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2" returned: 0 in 1.545s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:06 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2db32dee-6634-4f8d-a813-9c1e8917e986_6_y5j93odevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 22:59:06 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Converted 112.00 MB image at 72.42 MB/s Sep 06 22:59:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:06 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1G Sep 06 22:59:06 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:07 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 1G" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Downloaded image 2db32dee-6634-4f8d-a813-9c1e8917e986 ((None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}])) to volume 38076dd3-de45-49a1-afbf-42563c1e29e2 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Temporary image 2db32dee-6634-4f8d-a813-9c1e8917e986 for user 06786b8354a14e6da2d79da23651b859 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Marking volume 38076dd3-de45-49a1-afbf-42563c1e29e2 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Copying metadata from image 2db32dee-6634-4f8d-a813-9c1e8917e986 to 38076dd3-de45-49a1-afbf-42563c1e29e2. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Creating volume glance metadata for volume 38076dd3-de45-49a1-afbf-42563c1e29e2 backed by image 2db32dee-6634-4f8d-a813-9c1e8917e986 with: {'image_id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'image_name': 'tempest-scenario-img--1439828985', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b9f1f2-9c1c-4f13-97e8-377fda2ef85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38076dd3-de45-49a1-afbf-42563c1e29e2', 'volume_size': 1, 'image_id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2db32dee-6634-4f8d-a813-9c1e8917e986', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439828985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54d6ee61dcaf4dd48fba3afc4b18c474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2db32dee-6634-4f8d-a813-9c1e8917e986', 'created_at': datetime.datetime(2026, 9, 6, 20, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 58, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2db32dee-6634-4f8d-a813-9c1e8917e986/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3283a-8fe0-4799-a9a0-5020ea21009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 22:59:07 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Volume volume-38076dd3-de45-49a1-afbf-42563c1e29e2 (38076dd3-de45-49a1-afbf-42563c1e29e2): created successfully Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3283a-8fe0-4799-a9a0-5020ea21009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 22:59:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Flow 'volume_create_manager' (b1978192-a4a9-46c4-a05b-6facfffb45e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 22:59:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-884d7291-f7f6-4df7-b27a-8a9dd5dc3251 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created volume successfully. Sep 06 22:59:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2d39b522-5011-4a94-8c2e-ed37b8c2abe6 req-09e2e4e8-e078-4967-b52b-e834f931612e tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2d39b522-5011-4a94-8c2e-ed37b8c2abe6 req-09e2e4e8-e078-4967-b52b-e834f931612e tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2d39b522-5011-4a94-8c2e-ed37b8c2abe6 req-09e2e4e8-e078-4967-b52b-e834f931612e tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2d39b522-5011-4a94-8c2e-ed37b8c2abe6 req-09e2e4e8-e078-4967-b52b-e834f931612e tempest-TestInstancesWithCinderVolumes-1151826181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-38076dd3-de45-49a1-afbf-42563c1e29e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09ca54a2-2999-4a17-b0c4-c252d807d246', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:59:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-2d39b522-5011-4a94-8c2e-ed37b8c2abe6 req-09e2e4e8-e078-4967-b52b-e834f931612e tempest-TestInstancesWithCinderVolumes-1151826181 None] attachment_update completed successfully. Sep 06 22:59:20 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:59:20 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=21,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 22:59:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d9351ee6-21d5-4ea9-9314-ed42dc48844a req-58dab6e3-432e-4fce-a5d8-9cbfb29ced24 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d9351ee6-21d5-4ea9-9314-ed42dc48844a req-58dab6e3-432e-4fce-a5d8-9cbfb29ced24 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d9351ee6-21d5-4ea9-9314-ed42dc48844a req-58dab6e3-432e-4fce-a5d8-9cbfb29ced24 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d9351ee6-21d5-4ea9-9314-ed42dc48844a req-58dab6e3-432e-4fce-a5d8-9cbfb29ced24 tempest-TestInstancesWithCinderVolumes-1151826181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-9bd6d63a-c134-445a-a1a8-41c2992f7958', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '928421d1-3e0d-4ca9-9fc7-746f6d8e83ae', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:59:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d9351ee6-21d5-4ea9-9314-ed42dc48844a req-58dab6e3-432e-4fce-a5d8-9cbfb29ced24 tempest-TestInstancesWithCinderVolumes-1151826181 None] attachment_update completed successfully. Sep 06 22:59:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-929e3d2d-7732-4925-8eea-19f9fd942f7a req-315171fd-986b-4249-a8f9-f026c1db5c77 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-929e3d2d-7732-4925-8eea-19f9fd942f7a req-315171fd-986b-4249-a8f9-f026c1db5c77 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-929e3d2d-7732-4925-8eea-19f9fd942f7a req-315171fd-986b-4249-a8f9-f026c1db5c77 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-929e3d2d-7732-4925-8eea-19f9fd942f7a req-315171fd-986b-4249-a8f9-f026c1db5c77 tempest-TestInstancesWithCinderVolumes-1151826181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-99b9f5db-fdf4-4af0-8705-777348120af3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebb823cd-2020-48fa-be60-35f2a439090f', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 22:59:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-929e3d2d-7732-4925-8eea-19f9fd942f7a req-315171fd-986b-4249-a8f9-f026c1db5c77 tempest-TestInstancesWithCinderVolumes-1151826181 None] attachment_update completed successfully. Sep 06 22:59:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d3bd3530-8f19-4382-8645-3ae20f98f5bb req-5b432105-67b5-4e26-8d12-c305ca579054 tempest-TestInstancesWithCinderVolumes-1151826181 None] Terminate volume connection completed successfully. Sep 06 22:59:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d3bd3530-8f19-4382-8645-3ae20f98f5bb req-5b432105-67b5-4e26-8d12-c305ca579054 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleting attachment 928421d1-3e0d-4ca9-9fc7-746f6d8e83ae. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-9bd6d63a-c134-445a-a1a8-41c2992f7958-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-9bd6d63a-c134-445a-a1a8-41c2992f7958-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-quobyte-9bd6d63a-c134-445a-a1a8-41c2992f7958" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-9bd6d63a-c134-445a-a1a8-41c2992f7958" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f15c4d-7133-40df-81b5-0eecd9c9d141]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:48 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 Sep 06 22:59:48 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:48 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:48 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958 Sep 06 22:59:48 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:49 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bd6d63a-c134-445a-a1a8-41c2992f7958" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-9bd6d63a-c134-445a-a1a8-41c2992f7958" released by "delete_volume" :: held 0.662s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:59:49 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115424598-1552088249 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115424598-1552088249, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:49 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115424598-1552088249 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115424598-1552088249, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created reservations ['15940ad9-1311-46a1-9880-1ed87fd0c8ff', 'f9cc2818-2cec-444e-a18a-2cfd9be41424', '3540c13f-c047-4eb0-9f69-aa74d108a8db', '3eca702a-dd1d-419e-94bc-6b688279d3e5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:49 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:59:49 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:49 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:59:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleted volume successfully. Sep 06 22:59:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bc9ab0f7-02af-4b7e-b5e3-5a6b277cd243 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-9bd6d63a-c134-445a-a1a8-41c2992f7958-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:59:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-cfcae33c-820b-4733-b5e8-9654a6e170fd req-16e7e8d3-b743-4eb4-9877-22bec1588ee6 tempest-TestInstancesWithCinderVolumes-1151826181 None] Terminate volume connection completed successfully. Sep 06 22:59:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-cfcae33c-820b-4733-b5e8-9654a6e170fd req-16e7e8d3-b743-4eb4-9877-22bec1588ee6 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleting attachment ebb823cd-2020-48fa-be60-35f2a439090f. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-99b9f5db-fdf4-4af0-8705-777348120af3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-99b9f5db-fdf4-4af0-8705-777348120af3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-quobyte-99b9f5db-fdf4-4af0-8705-777348120af3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-99b9f5db-fdf4-4af0-8705-777348120af3" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e499fc-347a-428a-9c73-6a91dbc7bfd1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:52 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 Sep 06 22:59:52 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:53 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:53 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3 Sep 06 22:59:53 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:53 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-99b9f5db-fdf4-4af0-8705-777348120af3" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-99b9f5db-fdf4-4af0-8705-777348120af3" released by "delete_volume" :: held 0.673s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:59:53 devstack cinder-volume[87517]: WARNING cinder.quota [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-860033584-2128453592 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-860033584-2128453592, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:53 devstack cinder-volume[87517]: WARNING cinder.quota [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-860033584-2128453592 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-860033584-2128453592, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created reservations ['df0a8e86-fbb2-4493-bdd1-08a8bfcf93c7', '68c413c9-c518-4760-86ec-fc62bdc19d66', 'fc4d07b3-f8bb-499a-b96e-eb3e7895b541', 'b106c7e6-b1d3-4945-b9ce-49ea9edb0395'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:53 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:59:53 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:53 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:59:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleted volume successfully. Sep 06 22:59:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aaa29d0-3927-437c-bc82-5b7475fd7c49 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-99b9f5db-fdf4-4af0-8705-777348120af3-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:59:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-887ed243-b500-46ed-858d-9935aede3d2f req-3abdac41-a663-4a11-8a7e-62e8c47ac29c tempest-TestInstancesWithCinderVolumes-1151826181 None] Terminate volume connection completed successfully. Sep 06 22:59:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-887ed243-b500-46ed-858d-9935aede3d2f req-3abdac41-a663-4a11-8a7e-62e8c47ac29c tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleting attachment 09ca54a2-2999-4a17-b0c4-c252d807d246. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-38076dd3-de45-49a1-afbf-42563c1e29e2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-38076dd3-de45-49a1-afbf-42563c1e29e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "cinder-quobyte-38076dd3-de45-49a1-afbf-42563c1e29e2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-38076dd3-de45-49a1-afbf-42563c1e29e2" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[77771ad2-1c98-4f77-a055-89db871cddef]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:57 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 Sep 06 22:59:57 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:57 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:57 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2 Sep 06 22:59:57 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:57 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-38076dd3-de45-49a1-afbf-42563c1e29e2" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-quobyte-38076dd3-de45-49a1-afbf-42563c1e29e2" released by "delete_volume" :: held 0.622s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 22:59:57 devstack cinder-volume[87517]: WARNING cinder.quota [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-621336454-1034604467 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-621336454-1034604467, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:57 devstack cinder-volume[87517]: WARNING cinder.quota [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-621336454-1034604467 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-621336454-1034604467, it is now deprecated. Please use the default quota class for default quota. Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Created reservations ['6a07b55c-ce56-4a8a-adda-4b8f12e80912', 'b4a5a523-6da3-432a-a47b-eacf84994623', 'd9f61c80-467a-4d70-ad27-607c09e66816', '79c754e7-5454-4aa0-9cb9-380cc82533f9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 22:59:58 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 22:59:58 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 22:59:58 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 22:59:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Deleted volume successfully. Sep 06 22:59:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-846d36ff-d8b0-4437-9c81-f6da28c9f966 tempest-TestInstancesWithCinderVolumes-1151826181 None] Lock "cinder-38076dd3-de45-49a1-afbf-42563c1e29e2-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:00:05 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:00:05 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:00:05 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.231s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:00:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:00:08 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:00:08 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:00:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:00:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Flow 'volume_create_manager' (9b74265b-5303-4358-9871-25d44fab8178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:00:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6eeaba-1e2c-4e6f-8a93-5d8d8fa20e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6eeaba-1e2c-4e6f-8a93-5d8d8fa20e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-147555075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4078d4e7-d81e-453b-b430-9094e51bff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497050a20e104f6b9c5e18ee1e83299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:00:29Z,use_quota=True,user_id='ffcee64f708647c18f30ff2378020f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e9d037-3cc4-4a64-a785-27e75e46d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e9d037-3cc4-4a64-a785-27e75e46d317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba69f833-ca61-48f6-ad12-abd216775384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba69f833-ca61-48f6-ad12-abd216775384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4078d4e7-d81e-453b-b430-9094e51bff97', 'volume_name': 'volume-4078d4e7-d81e-453b-b430-9094e51bff97', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe02de9-ae12-4f7a-9fa6-4a90adc82830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe02de9-ae12-4f7a-9fa6-4a90adc82830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc496d-4496-448b-8df3-5fa89a359e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume 4078d4e7-d81e-453b-b430-9094e51bff97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4078d4e7-d81e-453b-b430-9094e51bff97', 'volume_size': 1} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-147555075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4078d4e7-d81e-453b-b430-9094e51bff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497050a20e104f6b9c5e18ee1e83299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:00:29Z,use_quota=True,user_id='ffcee64f708647c18f30ff2378020f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Creating volume 4078d4e7-d81e-453b-b430-9094e51bff97 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:00:29 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 1073741824 Sep 06 23:00:29 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Flow 'volume_create_manager' (2d29072b-c6e4-455f-bbc7-3693223b3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3694dae-457a-47aa-b8a5-23bfabe05e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3694dae-457a-47aa-b8a5-23bfabe05e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1615224939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2be177-9679-44e7-9e66-b445c2262bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497050a20e104f6b9c5e18ee1e83299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:00:29Z,use_quota=True,user_id='ffcee64f708647c18f30ff2378020f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4504ab5-7171-40b4-b326-939c11ad01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4504ab5-7171-40b4-b326-939c11ad01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528ae4c-fa74-40fe-b792-5b49fa7b6ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528ae4c-fa74-40fe-b792-5b49fa7b6ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2be177-9679-44e7-9e66-b445c2262bda', 'volume_name': 'volume-9b2be177-9679-44e7-9e66-b445c2262bda', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13225b3-7251-4b38-8fdd-f8483ccc245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13225b3-7251-4b38-8fdd-f8483ccc245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dbbeb7-6fed-4f6b-bb6a-803197855ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume 9b2be177-9679-44e7-9e66-b445c2262bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2be177-9679-44e7-9e66-b445c2262bda', 'volume_size': 1} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:29 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 1073741824" returned: 0 in 0.491s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:00:29 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 Sep 06 23:00:29 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:00:29 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1615224939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2be177-9679-44e7-9e66-b445c2262bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497050a20e104f6b9c5e18ee1e83299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:00:29Z,use_quota=True,user_id='ffcee64f708647c18f30ff2378020f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Creating volume 9b2be177-9679-44e7-9e66-b445c2262bda {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc496d-4496-448b-8df3-5fa89a359e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4078d4e7-d81e-453b-b430-9094e51bff97', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03068b-0241-4c97-adca-69b7f4577697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:29 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda 1073741824 Sep 06 23:00:29 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume volume-4078d4e7-d81e-453b-b430-9094e51bff97 (4078d4e7-d81e-453b-b430-9094e51bff97): created successfully Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03068b-0241-4c97-adca-69b7f4577697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Flow 'volume_create_manager' (9b74265b-5303-4358-9871-25d44fab8178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:00:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3e5ca4f1-9c2b-425b-bcb6-deaa89c0171d tempest-TestServerVolumeAttachmentScenario-1792485481 None] Created volume successfully. Sep 06 23:00:30 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda 1073741824" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:00:30 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda Sep 06 23:00:30 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:00:30 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dbbeb7-6fed-4f6b-bb6a-803197855ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2be177-9679-44e7-9e66-b445c2262bda', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cbf3b3-da34-4fb0-b47a-812e9ff47ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:00:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Volume volume-9b2be177-9679-44e7-9e66-b445c2262bda (9b2be177-9679-44e7-9e66-b445c2262bda): created successfully Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cbf3b3-da34-4fb0-b47a-812e9ff47ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:00:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Flow 'volume_create_manager' (2d29072b-c6e4-455f-bbc7-3693223b3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:00:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9cdeb1c2-502a-4267-9766-fe66ec80e5ae tempest-TestServerVolumeAttachmentScenario-1792485481 None] Created volume successfully. Sep 06 23:00:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:00:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:00:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7b499009-e48a-4183-952d-ca26724f28a0 req-f624511d-414a-4a20-b3cd-befcfb936265 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:00:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7b499009-e48a-4183-952d-ca26724f28a0 req-f624511d-414a-4a20-b3cd-befcfb936265 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:00:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7b499009-e48a-4183-952d-ca26724f28a0 req-f624511d-414a-4a20-b3cd-befcfb936265 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:00:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-7b499009-e48a-4183-952d-ca26724f28a0 req-f624511d-414a-4a20-b3cd-befcfb936265 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-4078d4e7-d81e-453b-b430-9094e51bff97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11aec4bf-3829-4da6-adbb-e67ac60feabe', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:00:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-7b499009-e48a-4183-952d-ca26724f28a0 req-f624511d-414a-4a20-b3cd-befcfb936265 tempest-TestServerVolumeAttachmentScenario-1792485481 None] attachment_update completed successfully. Sep 06 23:01:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-bd2650fb-2657-4f6a-8bd9-b6f27289b966 req-d3d12c16-4e6c-4e92-ad49-072cd6458a17 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-bd2650fb-2657-4f6a-8bd9-b6f27289b966 req-d3d12c16-4e6c-4e92-ad49-072cd6458a17 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-bd2650fb-2657-4f6a-8bd9-b6f27289b966 req-d3d12c16-4e6c-4e92-ad49-072cd6458a17 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-bd2650fb-2657-4f6a-8bd9-b6f27289b966 req-d3d12c16-4e6c-4e92-ad49-072cd6458a17 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-9b2be177-9679-44e7-9e66-b445c2262bda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '160bf410-8fda-4922-9168-31d2047962e3', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:01:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-bd2650fb-2657-4f6a-8bd9-b6f27289b966 req-d3d12c16-4e6c-4e92-ad49-072cd6458a17 tempest-TestServerVolumeAttachmentScenario-1792485481 None] attachment_update completed successfully. Sep 06 23:01:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-8d11e11a-3043-4f90-932a-086c775d7ae0 req-80761015-f0f8-4594-a17f-d409caa38a64 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Terminate volume connection completed successfully. Sep 06 23:01:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-8d11e11a-3043-4f90-932a-086c775d7ae0 req-80761015-f0f8-4594-a17f-d409caa38a64 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Deleting attachment 160bf410-8fda-4922-9168-31d2047962e3. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:05 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:01:05 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:05 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:01:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:01:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-85f92076-579e-4c40-b252-a33448724f0e req-1895fda7-e3b7-46e5-9b0d-263c1d17a074 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Terminate volume connection completed successfully. Sep 06 23:01:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-85f92076-579e-4c40-b252-a33448724f0e req-1895fda7-e3b7-46e5-9b0d-263c1d17a074 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Deleting attachment 11aec4bf-3829-4da6-adbb-e67ac60feabe. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "cinder-9b2be177-9679-44e7-9e66-b445c2262bda-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-9b2be177-9679-44e7-9e66-b445c2262bda-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "cinder-quobyte-9b2be177-9679-44e7-9e66-b445c2262bda" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-quobyte-9b2be177-9679-44e7-9e66-b445c2262bda" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42319ae-80cd-4c51-a95f-01b17de10578]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:10 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda Sep 06 23:01:10 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:11 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:11 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda Sep 06 23:01:11 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:11 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9b2be177-9679-44e7-9e66-b445c2262bda" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-quobyte-9b2be177-9679-44e7-9e66-b445c2262bda" released by "delete_volume" :: held 0.652s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Created reservations ['7158a788-5e29-4597-b3cd-34cd27fc23b4', 'f5ec336b-782e-4705-8806-254162010483', 'c867b872-3a15-4fab-a004-ffb3dd2f0ff4', 'b1c2f255-1e91-4673-8679-750fc418e72a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:11 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:01:11 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:11 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:01:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Deleted volume successfully. Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f04ddb18-cf30-44bd-864b-755e78c61405 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-9b2be177-9679-44e7-9e66-b445c2262bda-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "cinder-4078d4e7-d81e-453b-b430-9094e51bff97-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-4078d4e7-d81e-453b-b430-9094e51bff97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "cinder-quobyte-4078d4e7-d81e-453b-b430-9094e51bff97" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-quobyte-4078d4e7-d81e-453b-b430-9094e51bff97" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe37cc28-f940-4c92-b17d-5daa7d9f88c7]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:11 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 Sep 06 23:01:11 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:12 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:12 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97 Sep 06 23:01:12 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:12 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-4078d4e7-d81e-453b-b430-9094e51bff97" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-quobyte-4078d4e7-d81e-453b-b430-9094e51bff97" released by "delete_volume" :: held 0.623s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Created reservations ['a57310be-8130-4a00-adda-c18c2458efbf', '04906c55-6128-49da-b27b-a8182fe04134', '74ae3b65-27bb-48f7-9ff6-569d2f02e9b6', '10099c39-a812-47c5-96c0-580db91eaf33'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:12 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:01:12 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:12 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:01:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Deleted volume successfully. Sep 06 23:01:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0d77176-8544-4972-b12e-e10290e7a403 tempest-TestServerVolumeAttachmentScenario-1792485481 None] Lock "cinder-4078d4e7-d81e-453b-b430-9094e51bff97-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:01:22 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:01:22 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Flow 'volume_create_manager' (3d66ffb6-c8f2-4602-a173-6ecdab7c7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8d95fa-f713-47a8-8ac4-57ae22cb551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8d95fa-f713-47a8-8ac4-57ae22cb551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1391641120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da581d4-80a2-489b-ab98-6e7382cd1002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608acff34dde4ff7913a496fb245ea0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:01:42Z,use_quota=True,user_id='f6533ef0d41e4e8797c5b9876b37efe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bca6ae-9039-462f-8ccf-5a481df3b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bca6ae-9039-462f-8ccf-5a481df3b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c217c158-86e7-4d6f-b27d-18d41abc1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c217c158-86e7-4d6f-b27d-18d41abc1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9da581d4-80a2-489b-ab98-6e7382cd1002', 'volume_name': 'volume-9da581d4-80a2-489b-ab98-6e7382cd1002', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae50a730-1960-45cc-8e32-bb3969783d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae50a730-1960-45cc-8e32-bb3969783d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1804cdd-424a-4f7d-913e-8edf214ddf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Volume 9da581d4-80a2-489b-ab98-6e7382cd1002: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9da581d4-80a2-489b-ab98-6e7382cd1002', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Trying to clone 9da581d4-80a2-489b-ab98-6e7382cd1002 from image 783de45c-ba65-43ef-be94-87e88c8ed95b at location (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 23:01:42 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Image download 20.69 MB at 20.69 MB/s Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c0cddd-5e4e-4def-a727-8d398ac2887c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:42 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD Sep 06 23:01:42 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:43 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b is fetched for user f6533ef0d41e4e8797c5b9876b37efe0. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[59436835-0386-493f-b5cb-980215129137]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:43 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD Sep 06 23:01:43 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:43 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1391641120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da581d4-80a2-489b-ab98-6e7382cd1002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608acff34dde4ff7913a496fb245ea0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:01:42Z,use_quota=True,user_id='f6533ef0d41e4e8797c5b9876b37efe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Creating volume 9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:01:43 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:43 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1073741824 Sep 06 23:01:43 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:43 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1073741824" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:43 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 Sep 06 23:01:43 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:44 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Attempting download of 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 9da581d4-80a2-489b-ab98-6e7382cd1002. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5428c04c-c255-478e-9d0c-3f1d1d92d59d]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:44 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak Sep 06 23:01:44 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:44 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:44 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak Sep 06 23:01:44 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:44 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak" returned: 1 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_783de45c-ba65-43ef-be94-87e88c8ed95b_p__9etak' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca4abb-e9bd-4333-aa56-1415486e239b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:01:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:44 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD Sep 06 23:01:44 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:45 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:45 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] 783de45c-ba65-43ef-be94-87e88c8ed95b was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 23:01:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:45 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 Sep 06 23:01:45 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:46 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002" returned: 0 in 1.482s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_783de45c-ba65-43ef-be94-87e88c8ed95b_9vij3iiodevstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:01:46 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Converted 112.00 MB image at 75.48 MB/s Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:01:46 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1G Sep 06 23:01:46 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:01:46 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 1G" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Downloaded image 783de45c-ba65-43ef-be94-87e88c8ed95b ((None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}])) to volume 9da581d4-80a2-489b-ab98-6e7382cd1002 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Temporary image 783de45c-ba65-43ef-be94-87e88c8ed95b for user f6533ef0d41e4e8797c5b9876b37efe0 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 23:01:46 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Marking volume 9da581d4-80a2-489b-ab98-6e7382cd1002 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Copying metadata from image 783de45c-ba65-43ef-be94-87e88c8ed95b to 9da581d4-80a2-489b-ab98-6e7382cd1002. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Creating volume glance metadata for volume 9da581d4-80a2-489b-ab98-6e7382cd1002 backed by image 783de45c-ba65-43ef-be94-87e88c8ed95b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1804cdd-424a-4f7d-913e-8edf214ddf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da581d4-80a2-489b-ab98-6e7382cd1002', 'volume_size': 1, 'image_id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/783de45c-ba65-43ef-be94-87e88c8ed95b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1587aa9fa2bc4c16871fa9405bab43d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '783de45c-ba65-43ef-be94-87e88c8ed95b', 'created_at': datetime.datetime(2026, 9, 6, 20, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 20, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/783de45c-ba65-43ef-be94-87e88c8ed95b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af230d29-1a4c-4606-9393-9d2798b3ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:01:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Volume volume-9da581d4-80a2-489b-ab98-6e7382cd1002 (9da581d4-80a2-489b-ab98-6e7382cd1002): created successfully Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af230d29-1a4c-4606-9393-9d2798b3ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:01:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Flow 'volume_create_manager' (3d66ffb6-c8f2-4602-a173-6ecdab7c7793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:01:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b7b7ea77-8e23-47fc-89c9-36cba7e62e3e tempest-TestShelveInstance-2086991659 None] Created volume successfully. Sep 06 23:01:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-64d6e767-fd72-4c1f-9f61-452958e72b31 req-d6fcf3bb-389e-4d49-976f-f182c9fa52f0 tempest-TestShelveInstance-2086991659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:01:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-64d6e767-fd72-4c1f-9f61-452958e72b31 req-d6fcf3bb-389e-4d49-976f-f182c9fa52f0 tempest-TestShelveInstance-2086991659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:01:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-64d6e767-fd72-4c1f-9f61-452958e72b31 req-d6fcf3bb-389e-4d49-976f-f182c9fa52f0 tempest-TestShelveInstance-2086991659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:01:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-64d6e767-fd72-4c1f-9f61-452958e72b31 req-d6fcf3bb-389e-4d49-976f-f182c9fa52f0 tempest-TestShelveInstance-2086991659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-9da581d4-80a2-489b-ab98-6e7382cd1002', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd379317c-a609-4888-a443-42830b0db2b2', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:01:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-64d6e767-fd72-4c1f-9f61-452958e72b31 req-d6fcf3bb-389e-4d49-976f-f182c9fa52f0 tempest-TestShelveInstance-2086991659 None] attachment_update completed successfully. Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:02:05 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:02:05 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:02:05 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:02:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:02:06 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:02:06 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=8,cinder:SELECT=11,cinder:INSERT=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:02:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-5cd5f69c-61c5-472b-86c2-945e5eeb0700 req-7d7bdb6a-77a0-459a-8ca3-fa4820f8a9e5 tempest-TestShelveInstance-2086991659 None] Terminate volume connection completed successfully. Sep 06 23:02:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-5cd5f69c-61c5-472b-86c2-945e5eeb0700 req-7d7bdb6a-77a0-459a-8ca3-fa4820f8a9e5 tempest-TestShelveInstance-2086991659 None] Deleting attachment d379317c-a609-4888-a443-42830b0db2b2. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:02:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ce044d8-a7f5-4e7d-b883-6be76615ddc5 req-b75abc6a-6c20-4b3b-bc37-b51b79ecb38b tempest-TestShelveInstance-2086991659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:02:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ce044d8-a7f5-4e7d-b883-6be76615ddc5 req-b75abc6a-6c20-4b3b-bc37-b51b79ecb38b tempest-TestShelveInstance-2086991659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:02:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ce044d8-a7f5-4e7d-b883-6be76615ddc5 req-b75abc6a-6c20-4b3b-bc37-b51b79ecb38b tempest-TestShelveInstance-2086991659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:02:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-7ce044d8-a7f5-4e7d-b883-6be76615ddc5 req-b75abc6a-6c20-4b3b-bc37-b51b79ecb38b tempest-TestShelveInstance-2086991659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-9da581d4-80a2-489b-ab98-6e7382cd1002', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbd3afa5-6eeb-47c7-b0ad-97e12c25881a', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:02:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-7ce044d8-a7f5-4e7d-b883-6be76615ddc5 req-b75abc6a-6c20-4b3b-bc37-b51b79ecb38b tempest-TestShelveInstance-2086991659 None] attachment_update completed successfully. Sep 06 23:02:30 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:02:30 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:02:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-4dcf25b2-1f52-4231-8596-1e3c2eee3c12 tempest-TestShelveInstance-2086991659 None] Terminate volume connection completed successfully. Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-4dcf25b2-1f52-4231-8596-1e3c2eee3c12 tempest-TestShelveInstance-2086991659 None] Deleting attachment cbd3afa5-6eeb-47c7-b0ad-97e12c25881a. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Acquiring lock "cinder-9da581d4-80a2-489b-ab98-6e7382cd1002-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "cinder-9da581d4-80a2-489b-ab98-6e7382cd1002-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Acquiring lock "cinder-quobyte-9da581d4-80a2-489b-ab98-6e7382cd1002" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "cinder-quobyte-9da581d4-80a2-489b-ab98-6e7382cd1002" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d96308-9441-4f71-bbd9-65d0b891b0c4]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:02:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:02:47 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 Sep 06 23:02:47 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:02:48 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002" returned: 0 in 0.385s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:02:48 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002 Sep 06 23:02:48 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:02:48 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9da581d4-80a2-489b-ab98-6e7382cd1002" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "cinder-quobyte-9da581d4-80a2-489b-ab98-6e7382cd1002" released by "delete_volume" :: held 0.697s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.quota [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Created reservations ['6e105eb4-d807-4999-b718-e16b64befdcd', '2fc71cc7-cd2d-4bf8-b0b1-2c114d40c0f4', '6052c3cf-01d3-40f2-a41b-e9aaee938656', '9bd0d97b-c44e-4ce6-87ef-19121c05534d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:02:48 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:02:48 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:02:48 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.manager [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:02:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Deleted volume successfully. Sep 06 23:02:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-0d070c74-b4b3-4fe8-901e-d8725b9ff4c1 req-223357f7-2c7a-448b-9360-b3a43126ae9b tempest-TestShelveInstance-2086991659 None] Lock "cinder-9da581d4-80a2-489b-ab98-6e7382cd1002-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:02:58 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:02:58 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:05 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:03:05 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:05 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:03:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Flow 'volume_create_manager' (75d6ce1d-6272-40b2-94cc-fa84e89bd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375a4af2-9380-450d-bd6a-a2af3304751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375a4af2-9380-450d-bd6a-a2af3304751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-571930309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806c5e6f-8fda-492d-947b-151e3e9c45db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c31327328041a8aa099218a088e753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:03:20Z,use_quota=True,user_id='a07c70d8cd3f41edaadf34dbc4e049f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7feada18-8d53-4979-85b4-a00d855f9426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7feada18-8d53-4979-85b4-a00d855f9426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2452c6f0-de82-447f-856d-7a7319c1aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2452c6f0-de82-447f-856d-7a7319c1aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806c5e6f-8fda-492d-947b-151e3e9c45db', 'volume_name': 'volume-806c5e6f-8fda-492d-947b-151e3e9c45db', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b27afe-1b05-4b1c-8a24-0a8ba68cb52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b27afe-1b05-4b1c-8a24-0a8ba68cb52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc620db-1369-489c-af14-456e448fbf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Volume 806c5e6f-8fda-492d-947b-151e3e9c45db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806c5e6f-8fda-492d-947b-151e3e9c45db', 'volume_size': 1} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-571930309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806c5e6f-8fda-492d-947b-151e3e9c45db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c31327328041a8aa099218a088e753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:03:20Z,use_quota=True,user_id='a07c70d8cd3f41edaadf34dbc4e049f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Creating volume 806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:03:20 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:20 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db 1073741824 Sep 06 23:03:20 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:20 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db 1073741824" returned: 0 in 0.450s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:20 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:03:20 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:21 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc620db-1369-489c-af14-456e448fbf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806c5e6f-8fda-492d-947b-151e3e9c45db', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851609eb-7ad6-4f85-9fdb-055ca9012f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:03:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Volume volume-806c5e6f-8fda-492d-947b-151e3e9c45db (806c5e6f-8fda-492d-947b-151e3e9c45db): created successfully Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851609eb-7ad6-4f85-9fdb-055ca9012f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:03:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Flow 'volume_create_manager' (75d6ce1d-6272-40b2-94cc-fa84e89bd647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:03:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-dd04992b-6e59-4ff6-b04d-7a05eb151304 tempest-TestStampPattern-1283224599 None] Created volume successfully. Sep 06 23:03:31 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:03:31 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:03:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d7ed1a6c-cd75-4c68-b7d9-636ee781a456 req-90bd413f-49c7-43c3-bb6f-fa6e49565bd0 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:03:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d7ed1a6c-cd75-4c68-b7d9-636ee781a456 req-90bd413f-49c7-43c3-bb6f-fa6e49565bd0 tempest-TestStampPattern-1283224599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:03:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d7ed1a6c-cd75-4c68-b7d9-636ee781a456 req-90bd413f-49c7-43c3-bb6f-fa6e49565bd0 tempest-TestStampPattern-1283224599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:03:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d7ed1a6c-cd75-4c68-b7d9-636ee781a456 req-90bd413f-49c7-43c3-bb6f-fa6e49565bd0 tempest-TestStampPattern-1283224599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-806c5e6f-8fda-492d-947b-151e3e9c45db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd268db0-97dd-4d4a-a24e-b4b31e90c5bd', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:03:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d7ed1a6c-cd75-4c68-b7d9-636ee781a456 req-90bd413f-49c7-43c3-bb6f-fa6e49565bd0 tempest-TestStampPattern-1283224599 None] attachment_update completed successfully. Sep 06 23:03:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-6c9fb0c3-49f1-4e17-b56f-681ee945476f req-62a574a4-71bf-4e8a-ade7-4a52192b4648 tempest-TestStampPattern-1283224599 None] Terminate volume connection completed successfully. Sep 06 23:03:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-6c9fb0c3-49f1-4e17-b56f-681ee945476f req-62a574a4-71bf-4e8a-ade7-4a52192b4648 tempest-TestStampPattern-1283224599 None] Deleting attachment dd268db0-97dd-4d4a-a24e-b4b31e90c5bd. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:03:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:03:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:03:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Creating offline snapshot 10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 of volume 806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:03:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7952474d-48be-470f-8bfb-5a965afdf929]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:03:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:54 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:03:54 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:55 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:55 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 1G Sep 06 23:03:55 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:55 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 1G" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c5e6f-8fda-492d-947b-151e3e9c45db -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:55 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c5e6f-8fda-492d-947b-151e3e9c45db -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:03:55 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:55 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c5e6f-8fda-492d-947b-151e3e9c45db -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 is being set with open permissions: ugo+rw Sep 06 23:03:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:55 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:03:55 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:56 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:56 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info Sep 06 23:03:56 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:56 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:56 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info is being set with open permissions: ugo+rw Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:03:56 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info Sep 06 23:03:56 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:03:56 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.info" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:03:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:03:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-465a7532-0253-4a51-84a9-44f4e49aca72 tempest-TestStampPattern-1283224599 None] Create snapshot completed successfully Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Flow 'volume_create_manager' (d0503dbe-bffd-4ada-8190-4ee1e0914317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fd3013-ae0b-4943-8100-55e7e5a4287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fd3013-ae0b-4943-8100-55e7e5a4287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-585195647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c7df7e-6268-4f6f-8669-32c3a0f7f3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c31327328041a8aa099218a088e753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10b2ea86-fc19-42ef-bb3b-a82a9b0535c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:04:03Z,use_quota=True,user_id='a07c70d8cd3f41edaadf34dbc4e049f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af748a94-9bdd-4212-810e-1fd58af52178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af748a94-9bdd-4212-810e-1fd58af52178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de656cbc-29a2-4489-850d-601e1f4bc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de656cbc-29a2-4489-850d-601e1f4bc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16c7df7e-6268-4f6f-8669-32c3a0f7f3c4', 'volume_name': 'volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4', 'volume_size': 1, 'snapshot_id': '10b2ea86-fc19-42ef-bb3b-a82a9b0535c8'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b98664-d5c1-4f98-8d8e-00c62f46dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b98664-d5c1-4f98-8d8e-00c62f46dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424068f2-5008-4df6-b0a2-25ff990680bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Volume 16c7df7e-6268-4f6f-8669-32c3a0f7f3c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4', 'volume_size': 1, 'snapshot_id': '10b2ea86-fc19-42ef-bb3b-a82a9b0535c8'} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Creating volume 16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 from snapshot 10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] snapshot: 10b2ea86-fc19-42ef-bb3b-a82a9b0535c8, volume: 16c7df7e-6268-4f6f-8669-32c3a0f7f3c4, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83e9c74-e233-47c7-9624-9aca21d8fe22]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:04:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:03 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:04:03 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:04:04 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-806c5e6f-8fda-492d-947b-151e3e9c45db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[842eca5f-75dd-449a-ad93-be5de8ae76f3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:04 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:04:04 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:04:04 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 23:04:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:04 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 Sep 06 23:04:04 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:04:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:05 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:04:05 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:04:06 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 06 23:04:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:04:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:04:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:04:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:04:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:04:10 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" returned: 0 in 6.002s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:04:10 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Converted 1024.00 MB image at 170.59 MB/s Sep 06 23:04:10 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 is being set with open permissions: ugo+rw Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:10 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 Sep 06 23:04:10 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:04:10 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" released by "_copy_volume_from_snapshot" :: held 7.161s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" released by "_create_volume_from_snapshot" :: held 7.226s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.243s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424068f2-5008-4df6-b0a2-25ff990680bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4', 'volume_size': 1, 'snapshot_id': '10b2ea86-fc19-42ef-bb3b-a82a9b0535c8'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a665dc8c-0946-4177-9a69-b8d6b425fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:04:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Volume volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 (16c7df7e-6268-4f6f-8669-32c3a0f7f3c4): created successfully Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a665dc8c-0946-4177-9a69-b8d6b425fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:04:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Flow 'volume_create_manager' (d0503dbe-bffd-4ada-8190-4ee1e0914317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:04:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4f3662a7-8abe-48d0-8cf8-95ba1dc8319a tempest-TestStampPattern-1283224599 None] Created volume successfully. Sep 06 23:04:20 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:04:20 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:04:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2fdc850e-513d-4217-b797-10271b09d191 req-300f68ae-15c8-4840-aacd-62c5b4017f9d tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:04:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2fdc850e-513d-4217-b797-10271b09d191 req-300f68ae-15c8-4840-aacd-62c5b4017f9d tempest-TestStampPattern-1283224599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:04:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2fdc850e-513d-4217-b797-10271b09d191 req-300f68ae-15c8-4840-aacd-62c5b4017f9d tempest-TestStampPattern-1283224599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:04:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2fdc850e-513d-4217-b797-10271b09d191 req-300f68ae-15c8-4840-aacd-62c5b4017f9d tempest-TestStampPattern-1283224599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05', 'name': 'volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4271fa1-4d18-4659-a363-ce44d62ddf93', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 23:04:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-2fdc850e-513d-4217-b797-10271b09d191 req-300f68ae-15c8-4840-aacd-62c5b4017f9d tempest-TestStampPattern-1283224599 None] attachment_update completed successfully. Sep 06 23:04:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-63240ed4-9e5e-46e7-81e6-0966b12ede51 req-8a21821b-cd92-4d76-946b-89c6370baa5a tempest-TestStampPattern-1283224599 None] Terminate volume connection completed successfully. Sep 06 23:04:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-63240ed4-9e5e-46e7-81e6-0966b12ede51 req-8a21821b-cd92-4d76-946b-89c6370baa5a tempest-TestStampPattern-1283224599 None] Deleting attachment b4271fa1-4d18-4659-a363-ce44d62ddf93. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "cinder-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[285fd1e3-74da-4e4f-9736-a57fc01d119c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:04:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:04:59 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 Sep 06 23:04:59 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:00 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:00 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4 Sep 06 23:05:00 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:00 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4" released by "delete_volume" :: held 0.627s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Created reservations ['9e3485cd-acc3-48f6-97c8-3e798b71e932', 'd4ec9cdb-ad4d-4877-98cc-893beac269e5', '380eecf6-8f19-4fb0-993d-05f97c2de78d', 'b5e910c5-b695-4dad-a276-3203fd95abf1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:00 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:00 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:00 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Deleted volume successfully. Sep 06 23:05:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a239e79e-44af-4ca7-80f0-de9c3c3278f7 tempest-TestStampPattern-1283224599 None] Lock "cinder-16c7df7e-6268-4f6f-8669-32c3a0f7f3c4-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Deleting offline snapshot 10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 of volume 806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] snapshot_file for this snap is: volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3c1f17-adc7-40d2-a802-32033dca3cf8]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:01 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:05:01 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:01 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-806c5e6f-8fda-492d-947b-151e3e9c45db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[35730f44-b6d7-41c1-a925-50609f334c8a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:01 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:05:01 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:02 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:02 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:05:02 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:02 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:02 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8 Sep 06 23:05:02 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:02 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db.10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8" released by "_delete_snapshot" :: held 1.523s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" released by "delete_snapshot" :: held 1.544s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Created reservations ['890410c0-263e-4fe0-99ce-6d8b09278c57', '3dae724a-c24d-4f2e-b017-c1bf61bb8148', 'd3332a1f-f06b-4570-beb5-5c85f7106ac2', 'a5407bca-a78d-449f-857c-a1552bfd1b83'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Delete snapshot completed successfully. Sep 06 23:05:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3aea2f56-c72e-44b3-880c-43bff473ef7a tempest-TestStampPattern-1283224599 None] Lock "cinder-10b2ea86-fc19-42ef-bb3b-a82a9b0535c8-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:05 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:05 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:05 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:05:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-806c5e6f-8fda-492d-947b-151e3e9c45db-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "cinder-806c5e6f-8fda-492d-947b-151e3e9c45db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Acquiring lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" acquired by "delete_volume" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8714739-1a7d-4732-ab80-3aaa42b1351a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:06 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:05:06 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:07 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:07 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db Sep 06 23:05:07 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:07 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-806c5e6f-8fda-492d-947b-151e3e9c45db" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "cinder-quobyte-806c5e6f-8fda-492d-947b-151e3e9c45db" released by "delete_volume" :: held 0.652s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Created reservations ['ef88f80a-bdda-476d-94e7-56268806b941', '7305a9a8-05aa-467a-994c-9c36cd352086', '3a4cc70d-6908-4666-b0d5-317cd3f3970c', '74c791b6-549d-4b94-b8ce-de06ac6feed2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:07 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:07 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:07 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Deleted volume successfully. Sep 06 23:05:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccef65d2-ce44-48d8-90c9-85ce3ced2088 tempest-TestStampPattern-1283224599 None] Lock "cinder-806c5e6f-8fda-492d-947b-151e3e9c45db-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:17 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:05:17 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:05:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Flow 'volume_create_manager' (cd1585bd-6412-4885-a642-229658de9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a29062-8241-4d00-9172-20460f510458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a29062-8241-4d00-9172-20460f510458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a90dd-18c8-4d80-9391-2206fc52c5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06f6b78fc3a4a32a25a5f631e0a00b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:22Z,use_quota=True,user_id='295b22aa24784acc983ce510beeebda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daeaf9e3-0fcb-4624-b89e-20c065892339),volume_type_id=daeaf9e3-0fcb-4624-b89e-20c065892339)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6059e140-8eb4-4040-88b9-74ce14d3c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6059e140-8eb4-4040-88b9-74ce14d3c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1753d007-9387-4373-8a85-309db3fbd452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1753d007-9387-4373-8a85-309db3fbd452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '365a90dd-18c8-4d80-9391-2206fc52c5aa', 'volume_name': 'volume-365a90dd-18c8-4d80-9391-2206fc52c5aa', 'volume_size': 1, 'image_id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b9faba64107f80c0dc8727aa3760e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e06f6b78fc3a4a32a25a5f631e0a00b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a66cd95ebb228b1a86f7f97a7c01f65195a19d79966126ee4716803ef160aa13e613077d805f1184c8e6b6040b62286da4ac08657c7eb83b7822c60065def840', 'id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28b393e7-d040-4959-bacc-e3d764dd6819/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4d8b7a-5b62-4c71-8f56-92ba7b391cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4d8b7a-5b62-4c71-8f56-92ba7b391cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6a2a94-798b-46ff-95ce-0750f76d53c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Volume 365a90dd-18c8-4d80-9391-2206fc52c5aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-365a90dd-18c8-4d80-9391-2206fc52c5aa', 'volume_size': 1, 'image_id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b9faba64107f80c0dc8727aa3760e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e06f6b78fc3a4a32a25a5f631e0a00b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a66cd95ebb228b1a86f7f97a7c01f65195a19d79966126ee4716803ef160aa13e613077d805f1184c8e6b6040b62286da4ac08657c7eb83b7822c60065def840', 'id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28b393e7-d040-4959-bacc-e3d764dd6819/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Trying to clone 365a90dd-18c8-4d80-9391-2206fc52c5aa from image 28b393e7-d040-4959-bacc-e3d764dd6819 at location (None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 23:05:22 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Image download 0.00 MB at 0.00 MB/s Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[df091948-04eb-4043-9507-f46e5fb0d4d3]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:22 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:22 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:22 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:22 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:22 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:23 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Temporary image 28b393e7-d040-4959-bacc-e3d764dd6819 is fetched for user 295b22aa24784acc983ce510beeebda0. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[91700488-e898-4077-8154-d06b2424e5c9]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:23 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:23 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:23 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:23 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:23 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:23 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 1 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a90dd-18c8-4d80-9391-2206fc52c5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06f6b78fc3a4a32a25a5f631e0a00b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:22Z,use_quota=True,user_id='295b22aa24784acc983ce510beeebda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daeaf9e3-0fcb-4624-b89e-20c065892339),volume_type_id=daeaf9e3-0fcb-4624-b89e-20c065892339)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Creating volume 365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:23 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1073741824 Sep 06 23:05:23 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:24 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1073741824" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:24 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa Sep 06 23:05:24 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:24 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Attempting download of 28b393e7-d040-4959-bacc-e3d764dd6819 ((None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}])) to volume 365a90dd-18c8-4d80-9391-2206fc52c5aa. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfa3ed4-2ec5-4572-a0b9-021fba4e833a]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:24 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n Sep 06 23:05:24 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:24 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:24 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n Sep 06 23:05:24 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:25 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n" returned: 1 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28b393e7-d040-4959-bacc-e3d764dd6819_fa3v7g6n' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e20c5-0ef0-471c-8788-0bb3125d1cd9]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:25 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:25 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:25 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:25 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD Sep 06 23:05:25 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:25 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] 28b393e7-d040-4959-bacc-e3d764dd6819 was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 23:05:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:25 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa Sep 06 23:05:25 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:26 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_28b393e7-d040-4959-bacc-e3d764dd6819_kksgizk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:05:26 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:26 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1G Sep 06 23:05:26 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:26 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa 1G" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Downloaded image 28b393e7-d040-4959-bacc-e3d764dd6819 ((None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}])) to volume 365a90dd-18c8-4d80-9391-2206fc52c5aa successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Temporary image 28b393e7-d040-4959-bacc-e3d764dd6819 for user 295b22aa24784acc983ce510beeebda0 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Marking volume 365a90dd-18c8-4d80-9391-2206fc52c5aa as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Copying metadata from image 28b393e7-d040-4959-bacc-e3d764dd6819 to 365a90dd-18c8-4d80-9391-2206fc52c5aa. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Creating volume glance metadata for volume 365a90dd-18c8-4d80-9391-2206fc52c5aa backed by image 28b393e7-d040-4959-bacc-e3d764dd6819 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd9b9faba64107f80c0dc8727aa3760e3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6a2a94-798b-46ff-95ce-0750f76d53c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365a90dd-18c8-4d80-9391-2206fc52c5aa', 'volume_size': 1, 'image_id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28b393e7-d040-4959-bacc-e3d764dd6819', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b9faba64107f80c0dc8727aa3760e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e06f6b78fc3a4a32a25a5f631e0a00b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a66cd95ebb228b1a86f7f97a7c01f65195a19d79966126ee4716803ef160aa13e613077d805f1184c8e6b6040b62286da4ac08657c7eb83b7822c60065def840', 'id': '28b393e7-d040-4959-bacc-e3d764dd6819', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28b393e7-d040-4959-bacc-e3d764dd6819/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956358b1-dd66-4b9a-9f30-fd470dadfdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Volume volume-365a90dd-18c8-4d80-9391-2206fc52c5aa (365a90dd-18c8-4d80-9391-2206fc52c5aa): created successfully Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956358b1-dd66-4b9a-9f30-fd470dadfdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Flow 'volume_create_manager' (cd1585bd-6412-4885-a642-229658de9f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-00dc1d6f-bbfb-4015-9cc6-7b5a5ba7c459 tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Created volume successfully. Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Acquiring lock "cinder-365a90dd-18c8-4d80-9391-2206fc52c5aa-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "cinder-365a90dd-18c8-4d80-9391-2206fc52c5aa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Acquiring lock "cinder-quobyte-365a90dd-18c8-4d80-9391-2206fc52c5aa" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "cinder-quobyte-365a90dd-18c8-4d80-9391-2206fc52c5aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b799f-731c-4db0-9587-ad237a4c88ee]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:27 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa Sep 06 23:05:27 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:27 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:27 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa Sep 06 23:05:27 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:27 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-365a90dd-18c8-4d80-9391-2206fc52c5aa" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "cinder-quobyte-365a90dd-18c8-4d80-9391-2206fc52c5aa" released by "delete_volume" :: held 0.650s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 23:05:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 23:05:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Created reservations ['6f530abb-3a3e-440d-9fcb-c01680348b33', '490b49f7-4db0-4512-9db7-a54b1e2f7ef0', '0af7c49c-af19-4585-90d4-063ad8efa84f', 'b48ce686-70c2-4f05-a3fc-f32e4b18bfe4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:28 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:28 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:28 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Deleted volume successfully. Sep 06 23:05:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-33d48d7c-c226-470d-8c31-06a8f2a2811b tempest-VolumeAndVolumeTypeFromImageTest-666277452 None] Lock "cinder-365a90dd-18c8-4d80-9391-2206fc52c5aa-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=12,cinder:INSERT=8,cinder:UPDATE=13 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:05:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Flow 'volume_create_manager' (01b5933a-4cbe-48d9-b5ea-5f4ba2afbeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d936b96b-01cc-4235-b5e5-ab34c6dfb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d936b96b-01cc-4235-b5e5-ab34c6dfb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525784758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e956c7-2eb6-4c00-ae65-4b070487fec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5619ba45de4c48989d33f74f8f84b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:46Z,use_quota=True,user_id='af5c61a3e7d840ffa6f796d49f3b67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8398a228-88c6-4830-b661-b8355349ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8398a228-88c6-4830-b661-b8355349ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc592980-7beb-4769-982f-1391e8e91347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc592980-7beb-4769-982f-1391e8e91347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e956c7-2eb6-4c00-ae65-4b070487fec9', 'volume_name': 'volume-87e956c7-2eb6-4c00-ae65-4b070487fec9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccdf65c-4cc6-4b36-9e0c-79a6aa57595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccdf65c-4cc6-4b36-9e0c-79a6aa57595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526aaee-878e-431b-a524-de4bd67358d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Volume 87e956c7-2eb6-4c00-ae65-4b070487fec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e956c7-2eb6-4c00-ae65-4b070487fec9', 'volume_size': 1} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525784758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e956c7-2eb6-4c00-ae65-4b070487fec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5619ba45de4c48989d33f74f8f84b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:46Z,use_quota=True,user_id='af5c61a3e7d840ffa6f796d49f3b67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Creating volume 87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:45 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:45 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 1073741824 Sep 06 23:05:45 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (20ec0cb3-4b05-4dc0-9e1d-9b9735f3c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabce7b4-3700-4f56-bcf0-12fc9f0e0209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabce7b4-3700-4f56-bcf0-12fc9f0e0209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135844866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a186aa99-cca7-4930-a7f1-ac6d9c2ece23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:46Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bf31bb-5863-47a1-b771-a8c16af68f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bf31bb-5863-47a1-b771-a8c16af68f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17590491-1158-4c60-89e5-a703c21480d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17590491-1158-4c60-89e5-a703c21480d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a186aa99-cca7-4930-a7f1-ac6d9c2ece23', 'volume_name': 'volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227a9e3c-0305-457c-9fb6-276140cadd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227a9e3c-0305-457c-9fb6-276140cadd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daba3bcc-f970-4ec4-9bbd-a5cd7c20c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume a186aa99-cca7-4930-a7f1-ac6d9c2ece23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23', 'volume_size': 1} Sep 06 23:05:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:46 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 1073741824" returned: 0 in 0.501s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:46 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:05:46 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Flow 'volume_create_manager' (dbbcd2e8-147e-4627-ba3c-5dcc917edb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857bf2d3-54e2-4fa1-a493-80351deab932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857bf2d3-54e2-4fa1-a493-80351deab932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5476345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc48fdb4-63af-40c5-b880-271015e8751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf313938b83c499b8467f6b39ea5c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:47Z,use_quota=True,user_id='cd08d595cb764dac8bd83db6a85f9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d434e0-cf51-4262-bfac-46de45f2744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d434e0-cf51-4262-bfac-46de45f2744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9733071-5242-44f3-9e2c-d6e22acd2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9733071-5242-44f3-9e2c-d6e22acd2803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc48fdb4-63af-40c5-b880-271015e8751d', 'volume_name': 'volume-fc48fdb4-63af-40c5-b880-271015e8751d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb6e948-2d63-44fa-9725-b3db6c0ef0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb6e948-2d63-44fa-9725-b3db6c0ef0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d4c108-7383-4ca8-8cc8-ee0a3d3c439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Volume fc48fdb4-63af-40c5-b880-271015e8751d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc48fdb4-63af-40c5-b880-271015e8751d', 'volume_size': 1} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135844866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a186aa99-cca7-4930-a7f1-ac6d9c2ece23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:46Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume a186aa99-cca7-4930-a7f1-ac6d9c2ece23 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526aaee-878e-431b-a524-de4bd67358d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e956c7-2eb6-4c00-ae65-4b070487fec9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1354aae3-a090-4311-9d72-73b92df8af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:46 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 1073741824 Sep 06 23:05:46 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Volume volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 (87e956c7-2eb6-4c00-ae65-4b070487fec9): created successfully Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1354aae3-a090-4311-9d72-73b92df8af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Flow 'volume_create_manager' (01b5933a-4cbe-48d9-b5ea-5f4ba2afbeda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-be50075d-6284-493b-ac96-134e0c7006c6 tempest-VolumeDependencyTests-1623385244 None] Created volume successfully. Sep 06 23:05:47 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 1073741824" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:47 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 Sep 06 23:05:47 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:47 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5476345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc48fdb4-63af-40c5-b880-271015e8751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf313938b83c499b8467f6b39ea5c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:47Z,use_quota=True,user_id='cd08d595cb764dac8bd83db6a85f9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Creating volume fc48fdb4-63af-40c5-b880-271015e8751d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daba3bcc-f970-4ec4-9bbd-a5cd7c20c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:47 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d 1073741824 Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbff230c-d20e-4742-97a9-447c4f9b03d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:47 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 (a186aa99-cca7-4930-a7f1-ac6d9c2ece23): created successfully Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbff230c-d20e-4742-97a9-447c4f9b03d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (20ec0cb3-4b05-4dc0-9e1d-9b9735f3c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5b2ae740-2d79-4b09-bcb5-ed58453c775e tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:48 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d 1073741824" returned: 0 in 0.566s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:48 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d Sep 06 23:05:48 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (509601c2-eee4-442c-94b1-36cad54f8e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121d266-2514-4a2b-ac87-df2386ef7b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121d266-2514-4a2b-ac87-df2386ef7b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423768498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c231d91-5fb8-4061-8dc5-2464a7025c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:48Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b315ce96-d1f0-4c4e-9ec0-e882c4459c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b315ce96-d1f0-4c4e-9ec0-e882c4459c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a90f0d6-8a48-4655-ad9d-e5e0bb0de8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a90f0d6-8a48-4655-ad9d-e5e0bb0de8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c231d91-5fb8-4061-8dc5-2464a7025c08', 'volume_name': 'volume-6c231d91-5fb8-4061-8dc5-2464a7025c08', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb047371-f9d5-4893-80f4-3da2e9931293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb047371-f9d5-4893-80f4-3da2e9931293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697c7f29-75cf-439d-9dab-d795ca006da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume 6c231d91-5fb8-4061-8dc5-2464a7025c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c231d91-5fb8-4061-8dc5-2464a7025c08', 'volume_size': 1} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:48 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.577s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Creating offline snapshot a2303b49-6723-4e32-87b3-a024b256c454 of volume 87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d4c108-7383-4ca8-8cc8-ee0a3d3c439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc48fdb4-63af-40c5-b880-271015e8751d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f77d3-167f-4604-8849-43484c674fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c390ed5-5b02-4e0c-a470-ca5e93076149]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Volume volume-fc48fdb4-63af-40c5-b880-271015e8751d (fc48fdb4-63af-40c5-b880-271015e8751d): created successfully Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f77d3-167f-4604-8849-43484c674fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Flow 'volume_create_manager' (dbbcd2e8-147e-4627-ba3c-5dcc917edb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a421a9e0-1ccf-4b63-8b69-45aac5d8a45c tempest-ProjectReaderTests-1220408770 None] Created volume successfully. Sep 06 23:05:48 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:05:48 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (d274c394-fb44-45d3-b2c5-9e7bdbb4d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffd286a-09bd-4ec8-a6cd-95d1b7ed23e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffd286a-09bd-4ec8-a6cd-95d1b7ed23e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400165576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d51955-df83-4b11-a425-81acd7d934f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:49Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1518263b-dd7a-44d2-af16-1807c3c84b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1518263b-dd7a-44d2-af16-1807c3c84b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a2da3-551f-4a0a-ae08-267b8d983a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a2da3-551f-4a0a-ae08-267b8d983a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d51955-df83-4b11-a425-81acd7d934f1', 'volume_name': 'volume-58d51955-df83-4b11-a425-81acd7d934f1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07673c77-aa60-4196-845c-81c9f5c26932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07673c77-aa60-4196-845c-81c9f5c26932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d54c6e-5f05-44f5-b56d-2e4ab24fb9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume 58d51955-df83-4b11-a425-81acd7d934f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d51955-df83-4b11-a425-81acd7d934f1', 'volume_size': 1} Sep 06 23:05:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Acquiring lock "cinder-fc48fdb4-63af-40c5-b880-271015e8751d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:49 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.536s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "cinder-fc48fdb4-63af-40c5-b880-271015e8751d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:49 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 1G Sep 06 23:05:49 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Acquiring lock "cinder-quobyte-fc48fdb4-63af-40c5-b880-271015e8751d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "cinder-quobyte-fc48fdb4-63af-40c5-b880-271015e8751d" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5564e1-95a9-4ada-8ed4-c2570068a2c0]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:49 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d Sep 06 23:05:49 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (569eaad8-60e7-4358-9de9-78d1e0b3fef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b204ca-4115-40ad-843f-ba5bad0a4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b204ca-4115-40ad-843f-ba5bad0a4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960335210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bfba1e-a71d-4ce3-b563-827459e04077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:49Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac4334-e8b4-4b52-b328-3e4ac37e246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac4334-e8b4-4b52-b328-3e4ac37e246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66a90a4-438b-4e7f-a9db-6c5899d1bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66a90a4-438b-4e7f-a9db-6c5899d1bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bfba1e-a71d-4ce3-b563-827459e04077', 'volume_name': 'volume-a3bfba1e-a71d-4ce3-b563-827459e04077', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e6420-391f-4756-bad6-ee297e8f52b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e6420-391f-4756-bad6-ee297e8f52b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e90101-d699-441a-b23d-9270309284f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume a3bfba1e-a71d-4ce3-b563-827459e04077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bfba1e-a71d-4ce3-b563-827459e04077', 'volume_size': 1} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (b9ba57eb-6da1-4d77-96ea-51647db5addd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae6f2e8-a024-420b-8687-892afb2c8056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae6f2e8-a024-420b-8687-892afb2c8056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259895406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81646c5-2a49-4b4d-a433-9bbcec881c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1158ec5-c6c9-4b12-9e3f-32287affb8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1158ec5-c6c9-4b12-9e3f-32287affb8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40411559-5fcf-4bcf-859d-8b5208fa785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40411559-5fcf-4bcf-859d-8b5208fa785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81646c5-2a49-4b4d-a433-9bbcec881c16', 'volume_name': 'volume-e81646c5-2a49-4b4d-a433-9bbcec881c16', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a3105-960b-4ca3-80d1-9b114d7d56f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a3105-960b-4ca3-80d1-9b114d7d56f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0782a8d5-299a-4e0e-8cf9-00e0b9fc0311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume e81646c5-2a49-4b4d-a433-9bbcec881c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81646c5-2a49-4b4d-a433-9bbcec881c16', 'volume_size': 1} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 1G" returned: 0 in 0.713s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:49 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d" returned: 0 in 0.550s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:49 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:05:49 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:49 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d Sep 06 23:05:49 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:50 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-fc48fdb4-63af-40c5-b880-271015e8751d" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "cinder-quobyte-fc48fdb4-63af-40c5-b880-271015e8751d" released by "delete_volume" :: held 0.897s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Created reservations ['5047395b-5f9b-4a13-9a78-f54b07e8bb53', '5500731b-6c0c-4595-bdd6-2a9024462afe', '9d210d6e-9bbb-486c-b80d-c8ed44779b5f', '979a7d76-ae20-4b2d-8def-cfdbfefbb543'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:50 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:50 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 is being set with open permissions: ugo+rw Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:50 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:05:50 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:50 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:50 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Flow 'volume_create_manager' (8610ec46-f74c-4f4c-aba1-bffd458e8117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82ffaf3-8f76-4ba9-ae9d-517ed3839fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82ffaf3-8f76-4ba9-ae9d-517ed3839fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e78a6967d84d7cbf2828efcb96ce49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='76ce44cdbcce453291b9cef2435b6e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b115bac5-0d7f-4eda-a096-89a8b39b6457),volume_type_id=b115bac5-0d7f-4eda-a096-89a8b39b6457)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1364fd8a-cdd0-4f79-a85d-083bda8e5a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1364fd8a-cdd0-4f79-a85d-083bda8e5a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da36453a-bd6a-4482-a881-1542f6385182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (adb0f5eb-7449-4442-b112-b0f8fd71b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9baab43-88bb-4c9b-9d9b-6fe231ad85ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9baab43-88bb-4c9b-9d9b-6fe231ad85ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377327966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ce4e9b-9402-4cc4-91ad-d9364bb4120a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc7a86-e63e-4ce9-a9a8-09d18a0e6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc7a86-e63e-4ce9-a9a8-09d18a0e6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3fc5e9-dbf2-4910-9f06-7ce5a8936407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3fc5e9-dbf2-4910-9f06-7ce5a8936407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ce4e9b-9402-4cc4-91ad-d9364bb4120a', 'volume_name': 'volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a792cb37-c15c-402e-8df9-3c470291a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a792cb37-c15c-402e-8df9-3c470291a517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e776a99-1ba4-4b3f-969d-73c17e7f697a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume 09ce4e9b-9402-4cc4-91ad-d9364bb4120a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a', 'volume_size': 1} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:50 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:50 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info Sep 06 23:05:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Deleted volume successfully. Sep 06 23:05:50 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-938d78de-03fb-45d5-8fb9-4d0a5a796306 tempest-ProjectReaderTests-1220408770 None] Lock "cinder-fc48fdb4-63af-40c5-b880-271015e8751d-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da36453a-bd6a-4482-a881-1542f6385182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8', 'volume_name': 'volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8', 'volume_size': 1, 'image_id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb5e0234c4751c00f8929ef11e56649b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '25e78a6967d84d7cbf2828efcb96ce49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae14eb4d9278760c0b53b991fb2c424bdad5c4f3fb13b81cff828d0b013accee2401d8d75a565c77e91cd0600941503c3dba161b9928d96e95e4823cd81f8139', 'id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6772632-7ae6-4a22-95c6-4cbbb5414376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6772632-7ae6-4a22-95c6-4cbbb5414376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04032ce7-da7c-48cf-ac1d-908a2d88ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8', 'volume_size': 1, 'image_id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb5e0234c4751c00f8929ef11e56649b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '25e78a6967d84d7cbf2828efcb96ce49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae14eb4d9278760c0b53b991fb2c424bdad5c4f3fb13b81cff828d0b013accee2401d8d75a565c77e91cd0600941503c3dba161b9928d96e95e4823cd81f8139', 'id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Trying to clone 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 from image b1b0c420-ddc0-4b1d-9a79-388b32261c18 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 23:05:50 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Image download 0.00 MB at 0.00 MB/s Sep 06 23:05:50 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:50 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info is being set with open permissions: ugo+rw Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d77b7-17f4-4026-97fd-f4eacc70ab67]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:50 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info Sep 06 23:05:50 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:50 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:50 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.info" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.822s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423768498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c231d91-5fb8-4061-8dc5-2464a7025c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:48Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume 6c231d91-5fb8-4061-8dc5-2464a7025c08 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:51 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:51 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 1073741824 Sep 06 23:05:51 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Flow 'volume_create_manager' (3e81f1d3-bbb8-44da-a2b0-682977665994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a1d5fc-df0f-41f9-b963-330973a4ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a1d5fc-df0f-41f9-b963-330973a4ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728644491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a487dd-0f3f-4cb8-b238-ef26594ac030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf313938b83c499b8467f6b39ea5c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:51Z,use_quota=True,user_id='cd08d595cb764dac8bd83db6a85f9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00b9201-fce5-4238-83a3-c0f1d36ddc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00b9201-fce5-4238-83a3-c0f1d36ddc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eff1369-da43-4d95-839a-9188bcacb9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eff1369-da43-4d95-839a-9188bcacb9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a487dd-0f3f-4cb8-b238-ef26594ac030', 'volume_name': 'volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49880997-cb07-4c50-9eb3-be85f991b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49880997-cb07-4c50-9eb3-be85f991b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92017ee6-a2d9-4cbe-9599-fdac9e2d17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Volume d2a487dd-0f3f-4cb8-b238-ef26594ac030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030', 'volume_size': 1} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-385fcb97-f460-4a2f-ac5c-83939564d791 tempest-VolumeDependencyTests-1623385244 None] Create snapshot completed successfully Sep 06 23:05:51 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:51 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 1073741824" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:51 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Temporary image b1b0c420-ddc0-4b1d-9a79-388b32261c18 is fetched for user 76ce44cdbcce453291b9cef2435b6e01. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:51 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 Sep 06 23:05:51 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3633c1a-ff11-4d62-a58a-db99bf0a2838]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:51 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:51 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400165576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d51955-df83-4b11-a425-81acd7d934f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:49Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume 58d51955-df83-4b11-a425-81acd7d934f1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697c7f29-75cf-439d-9dab-d795ca006da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c231d91-5fb8-4061-8dc5-2464a7025c08', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 1073741824 Sep 06 23:05:51 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c60f0-c6cb-4b7b-abcb-00de59094a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 (6c231d91-5fb8-4061-8dc5-2464a7025c08): created successfully Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c60f0-c6cb-4b7b-abcb-00de59094a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (509601c2-eee4-442c-94b1-36cad54f8e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b154ba29-2669-4675-be62-a0a573f3ec46 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:52 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:52 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:52 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:52 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:52 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 1073741824" returned: 0 in 0.538s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:52 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 Sep 06 23:05:52 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Flow 'volume_create_manager' (160ffbf4-e96f-4a3b-b677-d8c1ec1634a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b33c642-a5de-4979-8b07-1ebd7726b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b33c642-a5de-4979-8b07-1ebd7726b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1236137734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a217c48f-ee7b-452a-a822-e1325086ec62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5619ba45de4c48989d33f74f8f84b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2303b49-6723-4e32-87b3-a024b256c454,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:53Z,use_quota=True,user_id='af5c61a3e7d840ffa6f796d49f3b67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee486310-df53-48bf-ad1f-488377505f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee486310-df53-48bf-ad1f-488377505f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aeedf2-35f6-4636-8ae8-fe7bd807c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aeedf2-35f6-4636-8ae8-fe7bd807c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a217c48f-ee7b-452a-a822-e1325086ec62', 'volume_name': 'volume-a217c48f-ee7b-452a-a822-e1325086ec62', 'volume_size': 1, 'snapshot_id': 'a2303b49-6723-4e32-87b3-a024b256c454'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210a2d0-1024-41c2-98e3-f9d87c16a8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c210a2d0-1024-41c2-98e3-f9d87c16a8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe8dacd-e1e3-48e9-8c72-3bb893f02ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Volume a217c48f-ee7b-452a-a822-e1325086ec62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a217c48f-ee7b-452a-a822-e1325086ec62', 'volume_size': 1, 'snapshot_id': 'a2303b49-6723-4e32-87b3-a024b256c454'} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960335210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bfba1e-a71d-4ce3-b563-827459e04077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:49Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume a3bfba1e-a71d-4ce3-b563-827459e04077 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:52 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d54c6e-5f05-44f5-b56d-2e4ab24fb9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d51955-df83-4b11-a425-81acd7d934f1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 1073741824 Sep 06 23:05:52 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fade1437-6aa6-43c9-974a-1414e64c999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-58d51955-df83-4b11-a425-81acd7d934f1 (58d51955-df83-4b11-a425-81acd7d934f1): created successfully Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fade1437-6aa6-43c9-974a-1414e64c999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (d274c394-fb44-45d3-b2c5-9e7bdbb4d77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2175d5c1-9e3c-4eae-b51c-86163b1b381d tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:53 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 1073741824" returned: 0 in 0.428s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:53 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 Sep 06 23:05:53 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:53 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.734s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259895406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81646c5-2a49-4b4d-a433-9bbcec881c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume e81646c5-2a49-4b4d-a433-9bbcec881c16 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:53 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:53 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 1073741824 Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e90101-d699-441a-b23d-9270309284f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bfba1e-a71d-4ce3-b563-827459e04077', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:53 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ccf00b-7f16-4e62-8797-c3c141d92287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-a3bfba1e-a71d-4ce3-b563-827459e04077 (a3bfba1e-a71d-4ce3-b563-827459e04077): created successfully Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ccf00b-7f16-4e62-8797-c3c141d92287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (569eaad8-60e7-4358-9de9-78d1e0b3fef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f0d51b25-54b4-430a-bc2d-d52023d03887 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:53 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 1073741824" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:53 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 Sep 06 23:05:53 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:54 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16" returned: 0 in 0.231s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377327966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ce4e9b-9402-4cc4-91ad-d9364bb4120a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9b7d99441544d4a4a9e2618e38305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='13f2e28c98da46679e194597fdf6cca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Creating volume 09ce4e9b-9402-4cc4-91ad-d9364bb4120a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0782a8d5-299a-4e0e-8cf9-00e0b9fc0311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81646c5-2a49-4b4d-a433-9bbcec881c16', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90c0605-f65e-406b-81c6-7c5f86e846bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:54 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a 1073741824 Sep 06 23:05:54 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 (e81646c5-2a49-4b4d-a433-9bbcec881c16): created successfully Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90c0605-f65e-406b-81c6-7c5f86e846bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (b9ba57eb-6da1-4d77-96ea-51647db5addd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aebce53f-a615-4718-9912-e4c4d1a20b18 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:54 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a 1073741824" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:54 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a Sep 06 23:05:54 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:54 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728644491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a487dd-0f3f-4cb8-b238-ef26594ac030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf313938b83c499b8467f6b39ea5c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:51Z,use_quota=True,user_id='cd08d595cb764dac8bd83db6a85f9d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Creating volume d2a487dd-0f3f-4cb8-b238-ef26594ac030 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e776a99-1ba4-4b3f-969d-73c17e7f697a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:54 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 1073741824 Sep 06 23:05:54 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff4eb45-11c6-4bd3-97a7-7e7efde2bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Volume volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a (09ce4e9b-9402-4cc4-91ad-d9364bb4120a): created successfully Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff4eb45-11c6-4bd3-97a7-7e7efde2bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Flow 'volume_create_manager' (adb0f5eb-7449-4442-b112-b0f8fd71b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8ad050a6-d217-4dc5-af96-f3c7ddebe768 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created volume successfully. Sep 06 23:05:55 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 1073741824" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:55 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 Sep 06 23:05:55 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:55 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e78a6967d84d7cbf2828efcb96ce49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:05:50Z,use_quota=True,user_id='76ce44cdbcce453291b9cef2435b6e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b115bac5-0d7f-4eda-a096-89a8b39b6457),volume_type_id=b115bac5-0d7f-4eda-a096-89a8b39b6457)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Creating volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:55 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:55 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1073741824 Sep 06 23:05:55 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92017ee6-a2d9-4cbe-9599-fdac9e2d17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ee7188-2056-4819-bfcf-b531c32e50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:05:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Volume volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 (d2a487dd-0f3f-4cb8-b238-ef26594ac030): created successfully Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ee7188-2056-4819-bfcf-b531c32e50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Flow 'volume_create_manager' (3e81f1d3-bbb8-44da-a2b0-682977665994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:05:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-87590cc6-f855-4b22-85d0-799eeea0a905 tempest-ProjectReaderTests-1220408770 None] Created volume successfully. Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-09ce4e9b-9402-4cc4-91ad-d9364bb4120a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-09ce4e9b-9402-4cc4-91ad-d9364bb4120a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0090442-977a-415a-8fae-d2196fedc234]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:55 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a Sep 06 23:05:55 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1073741824" returned: 0 in 0.434s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 Sep 06 23:05:56 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a Sep 06 23:05:56 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.496s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454-a217c48f-ee7b-452a-a822-e1325086ec62" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454-a217c48f-ee7b-452a-a822-e1325086ec62" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Creating volume a217c48f-ee7b-452a-a822-e1325086ec62 from snapshot a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Attempting download of b1b0c420-ddc0-4b1d-9a79-388b32261c18 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}])) to volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] snapshot: a2303b49-6723-4e32-87b3-a024b256c454, volume: a217c48f-ee7b-452a-a822-e1325086ec62, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:56 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Acquiring lock "cinder-d2a487dd-0f3f-4cb8-b238-ef26594ac030-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b7f8e4-a5e3-45a5-baf6-5c7811a9d116]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[523df280-8324-410a-84cf-79a8d4f46147]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "cinder-d2a487dd-0f3f-4cb8-b238-ef26594ac030-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-09ce4e9b-9402-4cc4-91ad-d9364bb4120a" released by "delete_volume" :: held 0.776s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Acquiring lock "cinder-quobyte-d2a487dd-0f3f-4cb8-b238-ef26594ac030" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "cinder-quobyte-d2a487dd-0f3f-4cb8-b238-ef26594ac030" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:56 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:05:56 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c4806-d36f-4cac-999c-8dfde4c0dad1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['51a7fae1-cb69-4896-9744-75bf540b85e4', '183648c5-aab9-4188-a453-05596fe675c3', 'be609259-a3ed-4452-bf15-06f699d5889f', 'a33fd1ab-f2e3-4524-b6de-329dbcd14fd2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d Sep 06 23:05:56 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:56 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:56 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 Sep 06 23:05:56 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-e81646c5-2a49-4b4d-a433-9bbcec881c16-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:56 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-e81646c5-2a49-4b4d-a433-9bbcec881c16-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-e81646c5-2a49-4b4d-a433-9bbcec881c16" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-e81646c5-2a49-4b4d-a433-9bbcec881c16" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe67ff-0dc8-4bb5-8569-5fdc0044c9ea]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.605s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87e956c7-2eb6-4c00-ae65-4b070487fec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee9ace5-36e8-4d34-bcbb-b47356e9e575]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d Sep 06 23:05:57 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.431s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:05:57 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030 Sep 06 23:05:57 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d652be45-9230-4260-967a-0f9b615d4627 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-09ce4e9b-9402-4cc4-91ad-d9364bb4120a-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:57 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 Sep 06 23:05:57 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:05:57 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d" returned: 1 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0c420-ddc0-4b1d-9a79-388b32261c18_x74hf3_d' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e871846-da3d-42c9-968d-a0bf253e5ca6]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d2a487dd-0f3f-4cb8-b238-ef26594ac030" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "cinder-quobyte-d2a487dd-0f3f-4cb8-b238-ef26594ac030" released by "delete_volume" :: held 0.920s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:57 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16" returned: 0 in 0.505s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:57 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16 Sep 06 23:05:57 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Created reservations ['d4dd01cd-a582-484e-9628-18af216f6ffa', '1d8eac9b-cf83-46bb-904f-7d52d8ccc059', '72edcc3c-1770-4b80-97f7-1588911c7a3e', 'c39ce4b8-61cd-414f-b7a7-811dd975e53d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:57 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 Sep 06 23:05:57 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:57 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:57 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:57 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e81646c5-2a49-4b4d-a433-9bbcec881c16" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-e81646c5-2a49-4b4d-a433-9bbcec881c16" released by "delete_volume" :: held 0.863s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['94e37646-40aa-4e0a-9fc3-e5200d069d58', '26db1565-c6ea-46fa-8656-f64add226086', 'fa009d91-b565-4499-bcac-1f300587c081', 'd205b5ed-158f-4c04-8f73-82faff2ddbf9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:05:58 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD Sep 06 23:05:58 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:58 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Deleted volume successfully. Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e1f687cc-d50f-4c1d-9798-8a4934c1532c tempest-ProjectReaderTests-1220408770 None] Lock "cinder-d2a487dd-0f3f-4cb8-b238-ef26594ac030-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:58 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:05:58 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-a3bfba1e-a71d-4ce3-b563-827459e04077-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-a3bfba1e-a71d-4ce3-b563-827459e04077-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-a3bfba1e-a71d-4ce3-b563-827459e04077" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:05:58 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-a3bfba1e-a71d-4ce3-b563-827459e04077" acquired by "delete_volume" :: waited 0.053s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] b1b0c420-ddc0-4b1d-9a79-388b32261c18 was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[813749b1-0e8e-4dd8-9d2d-3b5722e3c49e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:58 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 Sep 06 23:05:58 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:58 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.577s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:05:58 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 Sep 06 23:05:58 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:05:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ccb1c98f-b697-4145-98eb-142581238d84 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-e81646c5-2a49-4b4d-a433-9bbcec881c16-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:05:59 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077" returned: 0 in 1.168s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:59 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077 Sep 06 23:05:59 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:05:59 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 06 23:05:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" returned: 0 in 1.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:05:59 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1b0c420-ddc0-4b1d-9a79-388b32261c18_qkmpypyqdevstack@QuobyteHD, size 0.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:05:59 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 23:05:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:05:59 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1G Sep 06 23:05:59 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:00 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a3bfba1e-a71d-4ce3-b563-827459e04077" returned: 0 in 0.746s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-a3bfba1e-a71d-4ce3-b563-827459e04077" released by "delete_volume" :: held 2.019s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['f21ed83e-0560-480c-8327-904cd0ae5d2c', '851dcbee-8c9f-49b0-b4e8-b5933c35ad20', '10d57240-c0a2-4967-bfab-0396ca1ef63a', 'cfee4ad7-9402-4525-b2b2-b8216df784fe'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:00 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 1G" returned: 0 in 0.839s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Downloaded image b1b0c420-ddc0-4b1d-9a79-388b32261c18 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}])) to volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Temporary image b1b0c420-ddc0-4b1d-9a79-388b32261c18 for user 76ce44cdbcce453291b9cef2435b6e01 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Marking volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Copying metadata from image b1b0c420-ddc0-4b1d-9a79-388b32261c18 to 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Creating volume glance metadata for volume 0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 backed by image b1b0c420-ddc0-4b1d-9a79-388b32261c18 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fb5e0234c4751c00f8929ef11e56649b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:00 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:00 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04032ce7-da7c-48cf-ac1d-908a2d88ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8', 'volume_size': 1, 'image_id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb5e0234c4751c00f8929ef11e56649b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '25e78a6967d84d7cbf2828efcb96ce49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae14eb4d9278760c0b53b991fb2c424bdad5c4f3fb13b81cff828d0b013accee2401d8d75a565c77e91cd0600941503c3dba161b9928d96e95e4823cd81f8139', 'id': 'b1b0c420-ddc0-4b1d-9a79-388b32261c18', 'created_at': datetime.datetime(2026, 9, 6, 21, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0c420-ddc0-4b1d-9a79-388b32261c18/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a08be79-3041-4e2f-b9c4-38310a374672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Volume volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 (0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8): created successfully Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a08be79-3041-4e2f-b9c4-38310a374672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Flow 'volume_create_manager' (8610ec46-f74c-4f4c-aba1-bffd458e8117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-60222000-3872-440f-8204-903583c909c4 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Created volume successfully. Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Acquiring lock "cinder-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "cinder-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Acquiring lock "cinder-quobyte-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "cinder-quobyte-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:01 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.693s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2254b-58e0-4351-8abb-3662bfe69096]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd1da580-74fa-4771-ae12-dd64d124ddb3 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-a3bfba1e-a71d-4ce3-b563-827459e04077-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:01 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 Sep 06 23:06:01 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-58d51955-df83-4b11-a425-81acd7d934f1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-58d51955-df83-4b11-a425-81acd7d934f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-58d51955-df83-4b11-a425-81acd7d934f1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-58d51955-df83-4b11-a425-81acd7d934f1" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3327698e-dc33-4357-84e4-327e549fa7aa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:02 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" returned: 0 in 0.876s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:02 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8 Sep 06 23:06:02 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:02 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 Sep 06 23:06:02 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:03 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" returned: 0 in 0.755s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "cinder-quobyte-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8" released by "delete_volume" :: held 1.772s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Created reservations ['91f4cecb-d6c2-484f-bb98-94bb9cc48ad3', 'fe3d025b-a11f-4277-b338-de30213ed26a', '2735bd56-0082-455d-9c47-851bd9616143', 'd0a772bd-9396-4aad-8803-a0a0637f1599'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:03 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1" returned: 0 in 1.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:03 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1 Sep 06 23:06:03 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:03 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:03 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:03 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-58d51955-df83-4b11-a425-81acd7d934f1" returned: 0 in 0.469s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-58d51955-df83-4b11-a425-81acd7d934f1" released by "delete_volume" :: held 1.933s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['da1c1b3e-ce89-4290-87c7-63981b32930a', 'dfa8f733-f2a8-4b00-b1ef-aabae5e94352', 'e2bf1fd3-265d-47bf-9ef3-7d60166f9669', '34cccd33-38ca-42be-97e8-88a398eb3e5f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:03 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62" returned: 0 in 6.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:06:03 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Converted 1024.00 MB image at 161.89 MB/s Sep 06 23:06:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 is being set with open permissions: ugo+rw Sep 06 23:06:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:04 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 Sep 06 23:06:04 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:04 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.633s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Deleted volume successfully. Sep 06 23:06:04 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:04 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86cfb8a0-6d0b-40fe-9f81-5fab11a49bf7 tempest-VolumeAndVolumeTypeFromImageTest-1319841756 None] Lock "cinder-0e8f3a6b-081a-43ac-a4a4-b3db929c5cd8-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-6c231d91-5fb8-4061-8dc5-2464a7025c08-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-6c231d91-5fb8-4061-8dc5-2464a7025c08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-6c231d91-5fb8-4061-8dc5-2464a7025c08" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-6c231d91-5fb8-4061-8dc5-2464a7025c08" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:04 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" released by "_copy_volume_from_snapshot" :: held 8.057s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3d9bb3-fecf-4be2-9202-cc893a6ffda4]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:04 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454-a217c48f-ee7b-452a-a822-e1325086ec62" released by "_create_volume_from_snapshot" :: held 8.236s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.264s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3d1f2c84-744e-472c-abb0-65e647cd8384 tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-58d51955-df83-4b11-a425-81acd7d934f1-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:04 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 Sep 06 23:06:04 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe8dacd-e1e3-48e9-8c72-3bb893f02ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a217c48f-ee7b-452a-a822-e1325086ec62', 'volume_size': 1, 'snapshot_id': 'a2303b49-6723-4e32-87b3-a024b256c454'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46662a48-464a-445f-9565-cb629d9caae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Volume volume-a217c48f-ee7b-452a-a822-e1325086ec62 (a217c48f-ee7b-452a-a822-e1325086ec62): created successfully Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46662a48-464a-445f-9565-cb629d9caae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Flow 'volume_create_manager' (160ffbf4-e96f-4a3b-b677-d8c1ec1634a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3df66dba-d760-44bf-ab21-9a909e095816 tempest-VolumeDependencyTests-1623385244 None] Created volume successfully. Sep 06 23:06:04 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:04 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08 Sep 06 23:06:04 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-a2303b49-6723-4e32-87b3-a024b256c454-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-a2303b49-6723-4e32-87b3-a024b256c454-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Deleting offline snapshot a2303b49-6723-4e32-87b3-a024b256c454 of volume 87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] snapshot_file for this snap is: volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[188cc9ff-7bf2-4465-ad5c-034fc9f1f54c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:05 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6c231d91-5fb8-4061-8dc5-2464a7025c08" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-6c231d91-5fb8-4061-8dc5-2464a7025c08" released by "delete_volume" :: held 0.769s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:05 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:06:05 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['e10aa8d5-d0aa-4d79-ae41-de3da0d37d6c', '11562548-f650-4cd4-ab8e-6ff0edcc2915', 'e34343a6-7c47-4b29-8387-fb20a44d7cfc', '49276ac6-5b31-482f-9487-a4872407ed9e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:05 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:05 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-a186aa99-cca7-4930-a7f1-ac6d9c2ece23-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:05 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.513s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87e956c7-2eb6-4c00-ae65-4b070487fec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-a186aa99-cca7-4930-a7f1-ac6d9c2ece23-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cec62f-d288-4889-8e65-334cda365274]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:05 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:05 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "cinder-quobyte-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a915ec34-0683-4674-80ea-4ed1ed6d8d63]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:05 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.491s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:05 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:06:05 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:06:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a124a8a3-2072-449a-afb7-1c7caae4402f tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-6c231d91-5fb8-4061-8dc5-2464a7025c08-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:06 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 Sep 06 23:06:06 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:06 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:06:06 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:06 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.751s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" returned: 0 in 0.567s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:06 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:06:06 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:06 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23 Sep 06 23:06:06 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:06 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-quobyte-a186aa99-cca7-4930-a7f1-ac6d9c2ece23" released by "delete_volume" :: held 0.946s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Created reservations ['df8ff3f8-5756-4b84-ba67-8233290e7aaa', '2dc04092-a0b8-4e3a-905a-74d98f48558c', 'e904ccda-afd8-4ca5-8729-d3af78fa62c0', 'ea6c2bec-82b5-4b9e-babe-eeed4a8e5ef2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:06 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.474s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:06 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454 Sep 06 23:06:06 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:06 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:06 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:07 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9.a2303b49-6723-4e32-87b3-a024b256c454" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:07 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Deleted volume successfully. Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a2303b49-6723-4e32-87b3-a024b256c454" released by "_delete_snapshot" :: held 2.238s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" released by "delete_snapshot" :: held 2.279s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48c5c4be-6ff5-4082-9475-1888ff7ce5cf tempest-CreateVolumesFromSourceVolumeTest-175418312 None] Lock "cinder-a186aa99-cca7-4930-a7f1-ac6d9c2ece23-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Created reservations ['e47c2a91-82c9-458f-b5db-1806fb2a0f9a', '7d5fd000-68f1-4b49-b0dc-43807e3b8543', 'e1568c3f-741f-46b2-adc0-5654f6fd654e', 'c7c92a15-a052-4a0a-8b9e-c4ede5caf6ed'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Delete snapshot completed successfully. Sep 06 23:06:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-918b4dcd-2289-4a7d-95d3-d3d74f886840 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-a2303b49-6723-4e32-87b3-a024b256c454-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-87e956c7-2eb6-4c00-ae65-4b070487fec9-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-87e956c7-2eb6-4c00-ae65-4b070487fec9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1ef2f-c876-4246-bff7-e19a67dd8923]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:08 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:06:08 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:08 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:08 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9 Sep 06 23:06:08 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:09 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-87e956c7-2eb6-4c00-ae65-4b070487fec9" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-87e956c7-2eb6-4c00-ae65-4b070487fec9" released by "delete_volume" :: held 0.848s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Created reservations ['791b0a22-da39-442b-9624-1c63a205d440', '37f4a0fe-6d57-4b4e-ad7f-4eacc8443992', '750e38be-1d94-4b28-85d8-a84c5ffe91e6', '75d8efdf-f9ef-43b3-bf57-075624b3073f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-a217c48f-ee7b-452a-a822-e1325086ec62-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:09 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:09 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-a217c48f-ee7b-452a-a822-e1325086ec62-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f40194e-d9c5-4aa6-8fd2-a3008c5d45f2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:09 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 Sep 06 23:06:09 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:09 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Deleted volume successfully. Sep 06 23:06:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50769c6f-793c-40fb-b9c7-4dd5655137a9 tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-87e956c7-2eb6-4c00-ae65-4b070487fec9-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:10 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62" returned: 0 in 0.537s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:10 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62 Sep 06 23:06:10 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:10 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-a217c48f-ee7b-452a-a822-e1325086ec62" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-quobyte-a217c48f-ee7b-452a-a822-e1325086ec62" released by "delete_volume" :: held 0.968s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (d1904b0a-286e-4cc6-a00d-88e99362135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a796e8-78fe-4e53-b618-135042bddaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a796e8-78fe-4e53-b618-135042bddaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124514430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e311f062-db35-4521-b300-882f5fa7a6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:11Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2b8380-7fb3-4a00-868f-eba766e2d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2b8380-7fb3-4a00-868f-eba766e2d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a331bb-aaaa-4542-8497-5a5a8ca83cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a331bb-aaaa-4542-8497-5a5a8ca83cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e311f062-db35-4521-b300-882f5fa7a6b4', 'volume_name': 'volume-e311f062-db35-4521-b300-882f5fa7a6b4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a3146-88e9-4aeb-979b-73909348facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a3146-88e9-4aeb-979b-73909348facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4818f72-debb-4f4b-9534-b05710bb21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Volume e311f062-db35-4521-b300-882f5fa7a6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e311f062-db35-4521-b300-882f5fa7a6b4', 'volume_size': 1} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124514430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e311f062-db35-4521-b300-882f5fa7a6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:11Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Creating volume e311f062-db35-4521-b300-882f5fa7a6b4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:10 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 1073741824 Sep 06 23:06:10 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Created reservations ['0e0e93a8-1d07-4d78-9d2d-3c522a064a97', '750f7dcc-3f26-4bfa-89b7-0ce77fbbffbd', '804cbe6c-c328-447a-8c7d-a6a8743e4871', '5dbf77b4-5d2b-46a2-96bf-49da47e71bf9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:11 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:11 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (be0ac72c-86e6-4c66-85c4-d871df006a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1cf3f0-0701-4167-8c3a-77401427d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1cf3f0-0701-4167-8c3a-77401427d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712480591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206922c8-1bfe-43ba-91bc-29f22f05258c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:11Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c78dcd-31a6-4152-9b6e-219bb1250bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c78dcd-31a6-4152-9b6e-219bb1250bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a57f87-cf5a-47e0-ba03-ce8165bfe840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a57f87-cf5a-47e0-ba03-ce8165bfe840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206922c8-1bfe-43ba-91bc-29f22f05258c', 'volume_name': 'volume-206922c8-1bfe-43ba-91bc-29f22f05258c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34832bb0-0627-4b8b-a872-bdce32d3af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34832bb0-0627-4b8b-a872-bdce32d3af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423b9f1a-170d-435f-975d-76139a049cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Volume 206922c8-1bfe-43ba-91bc-29f22f05258c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206922c8-1bfe-43ba-91bc-29f22f05258c', 'volume_size': 1} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:11 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:11 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 1073741824" returned: 0 in 0.783s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Deleted volume successfully. Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77030070-2db0-401b-b428-57097a26e66d tempest-VolumeDependencyTests-1623385244 None] Lock "cinder-a217c48f-ee7b-452a-a822-e1325086ec62-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:11 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 Sep 06 23:06:11 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (484172c7-d04b-4aae-b272-650d8cb5455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967a31d-4823-4892-8b5b-4fb7408aee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967a31d-4823-4892-8b5b-4fb7408aee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266062503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083df1a0-577f-4e79-96f2-e7691a57c29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c3321-b160-4a12-90c8-2d9ea6a1ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c3321-b160-4a12-90c8-2d9ea6a1ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3e1fd4-2102-454a-af9a-2353e3fb0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3e1fd4-2102-454a-af9a-2353e3fb0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083df1a0-577f-4e79-96f2-e7691a57c29f', 'volume_name': 'volume-083df1a0-577f-4e79-96f2-e7691a57c29f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c67386e-4240-4875-9ac9-c21757bc6696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c67386e-4240-4875-9ac9-c21757bc6696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ac17a-9f27-44db-b36a-63245bce222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Volume 083df1a0-577f-4e79-96f2-e7691a57c29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083df1a0-577f-4e79-96f2-e7691a57c29f', 'volume_size': 1} Sep 06 23:06:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:12 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712480591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206922c8-1bfe-43ba-91bc-29f22f05258c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:11Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Creating volume 206922c8-1bfe-43ba-91bc-29f22f05258c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4818f72-debb-4f4b-9534-b05710bb21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e311f062-db35-4521-b300-882f5fa7a6b4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c 1073741824 Sep 06 23:06:12 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187f78ff-6a67-4caa-af2e-40683f5227c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Volume volume-e311f062-db35-4521-b300-882f5fa7a6b4 (e311f062-db35-4521-b300-882f5fa7a6b4): created successfully Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187f78ff-6a67-4caa-af2e-40683f5227c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (d1904b0a-286e-4cc6-a00d-88e99362135a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ef813193-4bff-4627-931d-846d6dd7557d tempest-CreateVolumesFromImageTest-1736864756 None] Created volume successfully. Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (99e9c06b-923e-4e21-8bba-f4ec5bf58b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3014a6a1-0d52-4e7f-96c3-85cc2ede208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3014a6a1-0d52-4e7f-96c3-85cc2ede208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990906161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e788785-13e8-44f1-b122-72eed1013ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a53719-0b11-422b-b349-e0a8fae1e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a53719-0b11-422b-b349-e0a8fae1e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb0f69-1337-4edd-90a5-6801111833bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb0f69-1337-4edd-90a5-6801111833bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e788785-13e8-44f1-b122-72eed1013ff2', 'volume_name': 'volume-8e788785-13e8-44f1-b122-72eed1013ff2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd83299-5396-43bf-8b46-a4aa6f2c9b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd83299-5396-43bf-8b46-a4aa6f2c9b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c2fd70-1d74-46fa-abff-0963d9f8a84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Volume 8e788785-13e8-44f1-b122-72eed1013ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e788785-13e8-44f1-b122-72eed1013ff2', 'volume_size': 1} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (96adf790-a51c-4abe-99e1-9d6dcdd92d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e72ab5-8553-4463-9a4c-2925ab728913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e72ab5-8553-4463-9a4c-2925ab728913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899082478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65510ab-4b1c-4d30-b6fe-14afb12892c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b9445a-7e84-4603-955c-cb0ed6a9d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b9445a-7e84-4603-955c-cb0ed6a9d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d27440d-7df8-45e0-b730-a282dc8f0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d27440d-7df8-45e0-b730-a282dc8f0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65510ab-4b1c-4d30-b6fe-14afb12892c7', 'volume_name': 'volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36f1d16-a1c1-4cfa-a632-d99f19528474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36f1d16-a1c1-4cfa-a632-d99f19528474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87425d9-721b-495f-bf55-c9a304674025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Volume e65510ab-4b1c-4d30-b6fe-14afb12892c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7', 'volume_size': 1} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:12 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c 1073741824" returned: 0 in 0.661s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:12 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c Sep 06 23:06:12 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:13 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266062503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083df1a0-577f-4e79-96f2-e7691a57c29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Creating volume 083df1a0-577f-4e79-96f2-e7691a57c29f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:13 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423b9f1a-170d-435f-975d-76139a049cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206922c8-1bfe-43ba-91bc-29f22f05258c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:13 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f 1073741824 Sep 06 23:06:13 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b3bac8-461b-42cf-8ccc-2b3d43244c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Volume volume-206922c8-1bfe-43ba-91bc-29f22f05258c (206922c8-1bfe-43ba-91bc-29f22f05258c): created successfully Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b3bac8-461b-42cf-8ccc-2b3d43244c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (be0ac72c-86e6-4c66-85c4-d871df006a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ff6b8daa-9dbd-4e7f-b32b-a77c64b2fbdd tempest-CreateVolumesFromImageTest-1736864756 None] Created volume successfully. Sep 06 23:06:13 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f 1073741824" returned: 0 in 0.704s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:13 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f Sep 06 23:06:13 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:14 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990906161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e788785-13e8-44f1-b122-72eed1013ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Creating volume 8e788785-13e8-44f1-b122-72eed1013ff2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ac17a-9f27-44db-b36a-63245bce222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083df1a0-577f-4e79-96f2-e7691a57c29f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:14 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 1073741824 Sep 06 23:06:14 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef2dff1-a8cd-471f-acca-87e6e08a46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Volume volume-083df1a0-577f-4e79-96f2-e7691a57c29f (083df1a0-577f-4e79-96f2-e7691a57c29f): created successfully Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef2dff1-a8cd-471f-acca-87e6e08a46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (484172c7-d04b-4aae-b272-650d8cb5455a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8a962eeb-03dc-4dfb-bcda-1736363ece4b tempest-CreateVolumesFromImageTest-1736864756 None] Created volume successfully. Sep 06 23:06:14 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 1073741824" returned: 0 in 0.787s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:15 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 Sep 06 23:06:15 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:15 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.723s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899082478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65510ab-4b1c-4d30-b6fe-14afb12892c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef66d7b5a2dd45ed9460ddaf3cac0aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:12Z,use_quota=True,user_id='57aa6e1609a94292817c907494c9bf9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Creating volume e65510ab-4b1c-4d30-b6fe-14afb12892c7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:15 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 1073741824 Sep 06 23:06:15 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c2fd70-1d74-46fa-abff-0963d9f8a84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e788785-13e8-44f1-b122-72eed1013ff2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd21e7b-f177-40cd-adaa-7f2cfa0a01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Volume volume-8e788785-13e8-44f1-b122-72eed1013ff2 (8e788785-13e8-44f1-b122-72eed1013ff2): created successfully Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd21e7b-f177-40cd-adaa-7f2cfa0a01e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (99e9c06b-923e-4e21-8bba-f4ec5bf58b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e3427a29-6dd0-4821-a535-4b68dfb6dcf5 tempest-CreateVolumesFromImageTest-1736864756 None] Created volume successfully. Sep 06 23:06:15 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 1073741824" returned: 0 in 0.551s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:16 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 Sep 06 23:06:16 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:16 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87425d9-721b-495f-bf55-c9a304674025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257a3ee0-739f-4fd1-86c0-5812217d5be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Volume volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 (e65510ab-4b1c-4d30-b6fe-14afb12892c7): created successfully Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257a3ee0-739f-4fd1-86c0-5812217d5be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Flow 'volume_create_manager' (96adf790-a51c-4abe-99e1-9d6dcdd92d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b4989991-89e8-4cd9-a946-0ffb70ef6e04 tempest-CreateVolumesFromImageTest-1736864756 None] Created volume successfully. Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Flow 'volume_create_manager' (4d0d8350-5d3a-4cd0-80ce-e63fcf687149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2207d3-7e10-4d94-be5e-4240d4392a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2207d3-7e10-4d94-be5e-4240d4392a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5096d5-9e77-4dcd-b763-59eff98e079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f707a2754b144f2994d9af3b2ddc6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:17Z,use_quota=True,user_id='498808f5965642afa8352eb67832cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c53f8b9-ce27-4432-a830-3a53e8e768b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c53f8b9-ce27-4432-a830-3a53e8e768b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017c50e-5296-44d3-9461-3a84475f5825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-58c09337-424e-43c4-8e22-0e8f0c02cd2b tempest-ProjectAdminTests-1778690193 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6511421203613, 'free_capacity_gb': 1773.6511421203613, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-e65510ab-4b1c-4d30-b6fe-14afb12892c7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-e65510ab-4b1c-4d30-b6fe-14afb12892c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-quobyte-e65510ab-4b1c-4d30-b6fe-14afb12892c7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-e65510ab-4b1c-4d30-b6fe-14afb12892c7" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd7c5d-8be3-4fc4-826e-65810872d6b1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:17 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 Sep 06 23:06:17 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017c50e-5296-44d3-9461-3a84475f5825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa5096d5-9e77-4dcd-b763-59eff98e079f', 'volume_name': 'volume-aa5096d5-9e77-4dcd-b763-59eff98e079f', 'volume_size': 1, 'image_id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2f432905fffd0798b4c4ad880b7c35a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f707a2754b144f2994d9af3b2ddc6a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9115fa76e4d4bb7a0fd7ad747e9e85f73192e07244c5530b72804473df216dbd9fb058751a5af17cd47b7a6a0ea6b8d1b07a64b8170bfe40ebb76de7ca7853ad', 'id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'created_at': datetime.datetime(2026, 9, 6, 21, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075db778-cd57-4f7d-be38-96cbf60e8be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075db778-cd57-4f7d-be38-96cbf60e8be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c724c1f2-da6f-45c8-b4d1-58941a7843b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Volume aa5096d5-9e77-4dcd-b763-59eff98e079f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa5096d5-9e77-4dcd-b763-59eff98e079f', 'volume_size': 1, 'image_id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2f432905fffd0798b4c4ad880b7c35a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f707a2754b144f2994d9af3b2ddc6a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9115fa76e4d4bb7a0fd7ad747e9e85f73192e07244c5530b72804473df216dbd9fb058751a5af17cd47b7a6a0ea6b8d1b07a64b8170bfe40ebb76de7ca7853ad', 'id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'created_at': datetime.datetime(2026, 9, 6, 21, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f/file', 'properties': {}}, 'image_service': } Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Trying to clone aa5096d5-9e77-4dcd-b763-59eff98e079f from image bf34d968-4e12-4d64-8e4e-d5cb37ab283f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 23:06:17 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Image download 0.00 MB at 0.00 MB/s Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bdb1a5-8f5f-48c7-887a-59c4104aebd5]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:17 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7" returned: 0 in 0.469s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:17 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:17 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:17 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7 Sep 06 23:06:17 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:18 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:18 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e65510ab-4b1c-4d30-b6fe-14afb12892c7" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-e65510ab-4b1c-4d30-b6fe-14afb12892c7" released by "delete_volume" :: held 0.837s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:18 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:18 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Created reservations ['ab05d03e-d884-47bd-bb57-20627389c050', '1693dac3-0c5a-4e64-9c9b-99870c186e77', '3f49dd0c-af20-471c-9aca-a5e07cf9b6cd', '27c6fe69-74c7-46e5-a4da-d22e8e516ff2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:18 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:18 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:18 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Temporary image bf34d968-4e12-4d64-8e4e-d5cb37ab283f is fetched for user 498808f5965642afa8352eb67832cd35. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-8e788785-13e8-44f1-b122-72eed1013ff2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-8e788785-13e8-44f1-b122-72eed1013ff2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c5891-2c38-4f6f-ad36-fe12a08e7e07]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-quobyte-8e788785-13e8-44f1-b122-72eed1013ff2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-8e788785-13e8-44f1-b122-72eed1013ff2" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f152eef-7742-45a2-a814-b7d79b4ca733]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:18 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:18 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:18 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Deleted volume successfully. Sep 06 23:06:18 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 Sep 06 23:06:18 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-040e1ea8-5bbc-4f3d-ad58-3d9691574b9f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-e65510ab-4b1c-4d30-b6fe-14afb12892c7-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:19 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:19 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2" returned: 0 in 0.506s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:19 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2 Sep 06 23:06:19 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:19 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:19 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:19 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:19 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5096d5-9e77-4dcd-b763-59eff98e079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f707a2754b144f2994d9af3b2ddc6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:17Z,use_quota=True,user_id='498808f5965642afa8352eb67832cd35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Creating volume aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:19 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8e788785-13e8-44f1-b122-72eed1013ff2" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-8e788785-13e8-44f1-b122-72eed1013ff2" released by "delete_volume" :: held 0.930s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:19 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1073741824 Sep 06 23:06:19 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Created reservations ['2a36005a-6b7c-4e37-8b33-0ab8456b8c0a', 'bc567cb7-3f84-49fd-8c15-82b73e93a767', '121f5664-8dce-40da-9189-cfa84d4cba3c', '47e723c5-ce57-439f-9eda-ce469dd6cbfa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:19 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:19 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:20 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Deleted volume successfully. Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19e7197d-2498-44db-9aaf-3e7b493ac5dc tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-8e788785-13e8-44f1-b122-72eed1013ff2-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:20 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1073741824" returned: 0 in 0.639s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:20 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f Sep 06 23:06:20 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:20 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Attempting download of bf34d968-4e12-4d64-8e4e-d5cb37ab283f ((None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}])) to volume aa5096d5-9e77-4dcd-b763-59eff98e079f. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d9817a-d5b1-461d-b838-7e25caa0eb4f]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:20 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms Sep 06 23:06:20 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-083df1a0-577f-4e79-96f2-e7691a57c29f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-083df1a0-577f-4e79-96f2-e7691a57c29f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-quobyte-083df1a0-577f-4e79-96f2-e7691a57c29f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-083df1a0-577f-4e79-96f2-e7691a57c29f" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:21 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b6f66f-9268-4683-ad2e-e7549ba78e6e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:21 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f Sep 06 23:06:21 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:21 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms Sep 06 23:06:21 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:21 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms" returned: 1 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_r0wy7gms' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eba015-cae7-44b1-81d5-9be707e24aef]: (4, 'raw') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:21 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f" returned: 0 in 0.494s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:21 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f Sep 06 23:06:21 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:21 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:21 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:21 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:21 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-083df1a0-577f-4e79-96f2-e7691a57c29f" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-083df1a0-577f-4e79-96f2-e7691a57c29f" released by "delete_volume" :: held 0.918s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Created reservations ['2206a8f8-e394-4649-923b-7b3516095cfb', '7969166f-5486-4d16-a659-4fa782a56fc1', '9cd5d66e-8d69-41c6-81a3-f2068307dcff', '277c9b86-fc7e-497d-81bd-5b1725ac294b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:22 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD Sep 06 23:06:22 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:22 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:22 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:22 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] bf34d968-4e12-4d64-8e4e-d5cb37ab283f was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:22 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f Sep 06 23:06:22 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:22 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Deleted volume successfully. Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d197334-1902-4977-8b81-82e60a34059f tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-083df1a0-577f-4e79-96f2-e7691a57c29f-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:22 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf34d968-4e12-4d64-8e4e-d5cb37ab283f_zhnab59rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:06:22 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 23:06:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:22 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1G Sep 06 23:06:22 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-206922c8-1bfe-43ba-91bc-29f22f05258c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:23 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-206922c8-1bfe-43ba-91bc-29f22f05258c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f 1G" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Downloaded image bf34d968-4e12-4d64-8e4e-d5cb37ab283f ((None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}])) to volume aa5096d5-9e77-4dcd-b763-59eff98e079f successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Temporary image bf34d968-4e12-4d64-8e4e-d5cb37ab283f for user 498808f5965642afa8352eb67832cd35 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Marking volume aa5096d5-9e77-4dcd-b763-59eff98e079f as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Copying metadata from image bf34d968-4e12-4d64-8e4e-d5cb37ab283f to aa5096d5-9e77-4dcd-b763-59eff98e079f. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Creating volume glance metadata for volume aa5096d5-9e77-4dcd-b763-59eff98e079f backed by image bf34d968-4e12-4d64-8e4e-d5cb37ab283f with: {'image_id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f2f432905fffd0798b4c4ad880b7c35a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-quobyte-206922c8-1bfe-43ba-91bc-29f22f05258c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-206922c8-1bfe-43ba-91bc-29f22f05258c" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a48e0-7624-4ea7-8ca6-a590f16f026e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c724c1f2-da6f-45c8-b4d1-58941a7843b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5096d5-9e77-4dcd-b763-59eff98e079f', 'volume_size': 1, 'image_id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2f432905fffd0798b4c4ad880b7c35a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f707a2754b144f2994d9af3b2ddc6a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9115fa76e4d4bb7a0fd7ad747e9e85f73192e07244c5530b72804473df216dbd9fb058751a5af17cd47b7a6a0ea6b8d1b07a64b8170bfe40ebb76de7ca7853ad', 'id': 'bf34d968-4e12-4d64-8e4e-d5cb37ab283f', 'created_at': datetime.datetime(2026, 9, 6, 21, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 21, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf34d968-4e12-4d64-8e4e-d5cb37ab283f/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c6ac38-8241-4b29-8edb-bf523fbe345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Volume volume-aa5096d5-9e77-4dcd-b763-59eff98e079f (aa5096d5-9e77-4dcd-b763-59eff98e079f): created successfully Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c6ac38-8241-4b29-8edb-bf523fbe345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Flow 'volume_create_manager' (4d0d8350-5d3a-4cd0-80ce-e63fcf687149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12fdd880-7031-4865-9f1d-d14737501b78 tempest-VolumeImageDependencyTests-1287180416 None] Created volume successfully. Sep 06 23:06:23 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c Sep 06 23:06:23 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:23 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:23 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c Sep 06 23:06:23 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:24 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-206922c8-1bfe-43ba-91bc-29f22f05258c" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-206922c8-1bfe-43ba-91bc-29f22f05258c" released by "delete_volume" :: held 0.762s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Created reservations ['25204fd9-9fbc-4143-a3e1-680c881abe54', 'c5946a6e-23fc-47a1-b0c4-f1373c0998f3', '5a0dcca6-8e48-4242-a5a8-b63cad71b7f5', '0022b87f-c0f4-4376-83d9-7f7579fb91fc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:24 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:24 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-e311f062-db35-4521-b300-882f5fa7a6b4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-e311f062-db35-4521-b300-882f5fa7a6b4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "cinder-quobyte-e311f062-db35-4521-b300-882f5fa7a6b4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-e311f062-db35-4521-b300-882f5fa7a6b4" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3331761-76f5-44df-a19d-130ac12635e6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:24 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Deleted volume successfully. Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f79a5105-5a98-4669-9537-1882a8d065e7 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-206922c8-1bfe-43ba-91bc-29f22f05258c-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Acquiring lock "cinder-aa5096d5-9e77-4dcd-b763-59eff98e079f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "cinder-aa5096d5-9e77-4dcd-b763-59eff98e079f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:24 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 Sep 06 23:06:24 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Acquiring lock "cinder-quobyte-aa5096d5-9e77-4dcd-b763-59eff98e079f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "cinder-quobyte-aa5096d5-9e77-4dcd-b763-59eff98e079f" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4081dec-b017-4fea-ab35-a09ea1f63a21]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:25 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f Sep 06 23:06:25 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:25 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4" returned: 0 in 0.658s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:25 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4 Sep 06 23:06:25 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:25 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f" returned: 0 in 0.549s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:25 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f Sep 06 23:06:25 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:25 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-e311f062-db35-4521-b300-882f5fa7a6b4" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-quobyte-e311f062-db35-4521-b300-882f5fa7a6b4" released by "delete_volume" :: held 1.024s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Created reservations ['abd29b28-83f9-42d3-90a0-635ef231210c', 'f8e88a60-2b6c-4afb-a4a7-b432089d5e7e', 'd36d1c72-2f06-49aa-a871-96a0690e28dd', 'c3569dbf-21f3-45b2-9a1b-2adad1ea0030'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:25 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-aa5096d5-9e77-4dcd-b763-59eff98e079f" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "cinder-quobyte-aa5096d5-9e77-4dcd-b763-59eff98e079f" released by "delete_volume" :: held 0.878s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:25 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:25 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Created reservations ['4ce36f91-af02-4c8e-9161-0e159f3676ce', '97cd41f9-61fa-4272-a41e-878e4eb5a58a', 'fa57ae1a-a449-4bc3-911c-2931b0554645', '638b234f-9cfb-4c7f-86f4-4f24ec2e27aa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:26 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:26 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:26 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Deleted volume successfully. Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d54814ee-7902-4d11-adb6-ccd5fe241364 tempest-CreateVolumesFromImageTest-1736864756 None] Lock "cinder-e311f062-db35-4521-b300-882f5fa7a6b4-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:26 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Deleted volume successfully. Sep 06 23:06:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5c3247a8-5321-4bdd-9015-5149c416d9e5 tempest-VolumeImageDependencyTests-1287180416 None] Lock "cinder-aa5096d5-9e77-4dcd-b763-59eff98e079f-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (2b1779b1-6d66-479b-9518-6f8fd433d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23105abf-8dc8-49fb-97e6-fb2705397c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23105abf-8dc8-49fb-97e6-fb2705397c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469631045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc29dcc-6b56-44b9-b1e7-02c8e50c757b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:29Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e1a8b3-dff3-46af-9b35-4eac44af2d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e1a8b3-dff3-46af-9b35-4eac44af2d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4863ea07-33d1-446b-bc61-be54bbc22e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4863ea07-33d1-446b-bc61-be54bbc22e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc29dcc-6b56-44b9-b1e7-02c8e50c757b', 'volume_name': 'volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c2f975-e5d0-4d34-bd9f-e6c16ba5d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c2f975-e5d0-4d34-bd9f-e6c16ba5d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7968464-6b91-405c-84cb-6876a1358cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Volume edc29dcc-6b56-44b9-b1e7-02c8e50c757b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b', 'volume_size': 1} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469631045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc29dcc-6b56-44b9-b1e7-02c8e50c757b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:29Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Creating volume edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:28 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b 1073741824 Sep 06 23:06:28 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:29 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b 1073741824" returned: 0 in 0.552s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:29 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b Sep 06 23:06:29 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:29 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7968464-6b91-405c-84cb-6876a1358cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce541f3c-9550-4909-a453-137e685ab6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Volume volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b (edc29dcc-6b56-44b9-b1e7-02c8e50c757b): created successfully Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce541f3c-9550-4909-a453-137e685ab6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (2b1779b1-6d66-479b-9518-6f8fd433d996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-42d35dc3-b527-4679-9c86-313d02261ea5 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Flow 'volume_create_manager' (331955df-8d8e-4c57-9440-30026c7c047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e43b54a-b615-4182-9142-651e4e53c36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e43b54a-b615-4182-9142-651e4e53c36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf4a370-acc8-409b-9b2a-c3c46456bc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d204f8e18d04dbdab9a3218f7f5ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:31Z,use_quota=True,user_id='88bcc81d071047109eb50bf277023ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbc14cd-3b2c-4536-9f8a-82a4e7fb2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbc14cd-3b2c-4536-9f8a-82a4e7fb2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c514b34-c2fa-4e34-87ea-aca64e8746c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c514b34-c2fa-4e34-87ea-aca64e8746c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf4a370-acc8-409b-9b2a-c3c46456bc37', 'volume_name': 'volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e596e1fb-d048-4336-8a9b-8ad4b882d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e596e1fb-d048-4336-8a9b-8ad4b882d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb27f14-a65c-4a94-a26e-e8f3e2cd115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Volume 9bf4a370-acc8-409b-9b2a-c3c46456bc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37', 'volume_size': 1} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf4a370-acc8-409b-9b2a-c3c46456bc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d204f8e18d04dbdab9a3218f7f5ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:31Z,use_quota=True,user_id='88bcc81d071047109eb50bf277023ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Creating volume 9bf4a370-acc8-409b-9b2a-c3c46456bc37 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:30 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:30 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 1073741824 Sep 06 23:06:30 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (4a58eac2-14ed-40b9-8f9c-af4e03773279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f015aa7-ec87-4523-b0d7-b00efcec6978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f015aa7-ec87-4523-b0d7-b00efcec6978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283396550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaed396-eb45-4fb5-8e49-86e40df8fdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:31Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaccf49-f01d-4534-a04b-9fb7e51917e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaccf49-f01d-4534-a04b-9fb7e51917e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c876b91a-e028-49a5-8d1f-ed5c86309605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c876b91a-e028-49a5-8d1f-ed5c86309605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abaed396-eb45-4fb5-8e49-86e40df8fdf0', 'volume_name': 'volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3c3f1e-1dfe-4497-858d-24319c36ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3c3f1e-1dfe-4497-858d-24319c36ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69666081-094e-412e-a603-e4a158ae730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume abaed396-eb45-4fb5-8e49-86e40df8fdf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0', 'volume_size': 1} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:31 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 1073741824" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:31 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 Sep 06 23:06:31 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:31 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283396550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaed396-eb45-4fb5-8e49-86e40df8fdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:31Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb27f14-a65c-4a94-a26e-e8f3e2cd115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 1073741824 Sep 06 23:06:31 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18fd2f4-36d1-4ce7-af7d-a881d98b9828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Volume volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 (9bf4a370-acc8-409b-9b2a-c3c46456bc37): created successfully Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18fd2f4-36d1-4ce7-af7d-a881d98b9828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Flow 'volume_create_manager' (331955df-8d8e-4c57-9440-30026c7c047e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1deff733-1065-4891-bea3-8a23b1d05d71 tempest-CinderUnicodeTest-1310944543 None] Created volume successfully. Sep 06 23:06:32 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 1073741824" returned: 0 in 0.558s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:32 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 Sep 06 23:06:32 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:32 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.320s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69666081-094e-412e-a603-e4a158ae730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31986c-e651-46f8-98eb-10bcedc3a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot 3267dd00-ef47-4405-886e-f5f1bf01e307 of volume edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:06:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 (abaed396-eb45-4fb5-8e49-86e40df8fdf0): created successfully Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd31986c-e651-46f8-98eb-10bcedc3a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (4a58eac2-14ed-40b9-8f9c-af4e03773279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350a8e6-5d06-453e-b4ad-646c507a1581]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f0ac4dc9-cdd0-4442-b69e-57545709da7d tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:32 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b Sep 06 23:06:32 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:33 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" returned: 0 in 0.673s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:33 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 1G Sep 06 23:06:33 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Flow 'volume_create_manager' (668ced77-518f-47f9-aa63-4a506b497417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f45f59f-fce1-423f-9df2-bb9c1220be73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f45f59f-fce1-423f-9df2-bb9c1220be73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-291534443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba747b7-5e83-471c-9942-a556032986ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d204f8e18d04dbdab9a3218f7f5ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:34Z,use_quota=True,user_id='88bcc81d071047109eb50bf277023ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7079860d-be3c-485e-889a-06fe4f2ff3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7079860d-be3c-485e-889a-06fe4f2ff3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349f2907-7544-40c3-a167-116a2b5f15a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349f2907-7544-40c3-a167-116a2b5f15a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba747b7-5e83-471c-9942-a556032986ca', 'volume_name': 'volume-cba747b7-5e83-471c-9942-a556032986ca', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce4debf-d764-4456-b2bd-74792643169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce4debf-d764-4456-b2bd-74792643169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666e5e60-72bb-4838-857c-8844e1d820b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Volume cba747b7-5e83-471c-9942-a556032986ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba747b7-5e83-471c-9942-a556032986ca', 'volume_size': 1} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:33 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 1G" returned: 0 in 0.538s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:33 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 Sep 06 23:06:33 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:34 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 is being set with open permissions: ugo+rw Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:34 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 Sep 06 23:06:34 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:34 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:34 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info Sep 06 23:06:34 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:34 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info is being set with open permissions: ugo+rw Sep 06 23:06:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:34 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info Sep 06 23:06:34 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:35 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.393s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating offline snapshot 07655fdd-9283-401b-980f-ca999aed21b3 of volume abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:06:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-52717562-0201-4532-a460-8ea1ddf8f34a tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6fa5a-d46c-4cd7-a02b-001e51e90145]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:35 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 Sep 06 23:06:35 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-3267dd00-ef47-4405-886e-f5f1bf01e307-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:35 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0" returned: 0 in 0.448s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3267dd00-ef47-4405-886e-f5f1bf01e307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:35 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 1G Sep 06 23:06:35 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-3267dd00-ef47-4405-886e-f5f1bf01e307" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3267dd00-ef47-4405-886e-f5f1bf01e307" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot 3267dd00-ef47-4405-886e-f5f1bf01e307 of volume edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f17a1fa-ad3a-4291-b2bb-a65ba6a9b255]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:35 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 Sep 06 23:06:35 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:36 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 1G" returned: 0 in 0.609s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:36 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 Sep 06 23:06:36 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:36 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fad9b9-7b77-4b26-9767-54e2a63f614d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:36 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b Sep 06 23:06:36 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:36 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 is being set with open permissions: ugo+rw Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:36 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 Sep 06 23:06:36 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:36 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:36 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 Sep 06 23:06:36 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:36 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:37 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info Sep 06 23:06:37 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:37 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:37 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307 Sep 06 23:06:37 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:37 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:37 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info is being set with open permissions: ugo+rw Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:37 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info Sep 06 23:06:37 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:37 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b.3267dd00-ef47-4405-886e-f5f1bf01e307" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3267dd00-ef47-4405-886e-f5f1bf01e307" released by "_delete_snapshot" :: held 1.804s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" released by "delete_snapshot" :: held 1.836s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:37 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.info" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.832s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-291534443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba747b7-5e83-471c-9942-a556032986ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d204f8e18d04dbdab9a3218f7f5ccd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:34Z,use_quota=True,user_id='88bcc81d071047109eb50bf277023ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Creating volume cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Created reservations ['5b24eedc-a9ec-48b5-ba7a-af779a4ea7ae', 'dc248088-f2f4-40c7-91ed-a79de7d00c45', '9560c2d2-f008-40e8-b7ef-61a363893e11', 'a9bee414-98a1-4c3f-b60f-ffc99737868d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:37 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca 1073741824 Sep 06 23:06:37 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c5acf89d-034c-455b-bf76-81e9b2f8d735 tempest-CreateVolumesFromSnapshotTest-863729609 None] Create snapshot completed successfully Sep 06 23:06:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37783813-e45a-4bfa-89fd-5b7056d10579 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3267dd00-ef47-4405-886e-f5f1bf01e307-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-edc29dcc-6b56-44b9-b1e7-02c8e50c757b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "cinder-edc29dcc-6b56-44b9-b1e7-02c8e50c757b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4cc88-33cf-48e6-8f1f-27a48e28faf6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:38 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b Sep 06 23:06:38 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:38 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca 1073741824" returned: 0 in 0.524s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=163,cinder:UPDATE=224,cinder:INSERT=60,cinder:DELETE=18 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:38 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca Sep 06 23:06:38 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:38 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:38 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b Sep 06 23:06:38 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:38 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666e5e60-72bb-4838-857c-8844e1d820b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba747b7-5e83-471c-9942-a556032986ca', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c44edf-4dde-40a5-a2ef-ce5f049500a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=163,cinder:UPDATE=211,cinder:DELETE=22,cinder:INSERT=59 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:06:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Volume volume-cba747b7-5e83-471c-9942-a556032986ca (cba747b7-5e83-471c-9942-a556032986ca): created successfully Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c44edf-4dde-40a5-a2ef-ce5f049500a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Flow 'volume_create_manager' (668ced77-518f-47f9-aa63-4a506b497417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-55b27aa1-503b-4c71-926e-f4e532f94a40 tempest-CinderUnicodeTest-1310944543 None] Created volume successfully. Sep 06 23:06:38 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-edc29dcc-6b56-44b9-b1e7-02c8e50c757b" released by "delete_volume" :: held 0.854s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Created reservations ['1881d239-4daf-4677-8e1d-92eadb649324', 'a3fe90ad-c572-46ba-b7ea-f23944a0fa58', '312bcd5f-a6e7-4192-8f8b-875ea2d9e095', '3e1f1841-a2d2-4a8a-961a-1e74073d8a03'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:39 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:39 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:39 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-77cae75c-e807-4c15-90b2-e5ec6d7ed0eb tempest-ProjectMemberTests-1186030494 None] Lock "cinder-edc29dcc-6b56-44b9-b1e7-02c8e50c757b-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (a417cde3-b8cb-48f4-89bf-15390b064c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39719f27-5cd3-4004-b791-189a6464a49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Creating offline snapshot 2fdbd011-ef2c-4ea5-b322-d3df984c443f of volume cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39719f27-5cd3-4004-b791-189a6464a49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-528259631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88fe36f-eb84-4488-a4f6-2f329ea0f63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:39Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edd88bf-939c-46e3-a429-d664a2c4cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edd88bf-939c-46e3-a429-d664a2c4cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d58bb8-e5f4-4a23-8ff9-fc08419a82b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d58bb8-e5f4-4a23-8ff9-fc08419a82b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88fe36f-eb84-4488-a4f6-2f329ea0f63b', 'volume_name': 'volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9e898-3cef-44e8-9090-424ccf5436ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9e898-3cef-44e8-9090-424ccf5436ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7591dd3-72a9-4cd3-83a3-ac34b178b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume b88fe36f-eb84-4488-a4f6-2f329ea0f63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b', 'volume_size': 1} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2240894-ac15-4dd0-8c79-43787a25a585]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:39 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca Sep 06 23:06:39 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (6c4564c2-044b-4877-925b-51244ecf7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd36745-6f86-4586-a5ac-d816a4a4bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd36745-6f86-4586-a5ac-d816a4a4bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162229340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf92f525-47ad-47d4-abf6-ea6543ec3440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:40Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e5be8-9123-4c4b-be49-ba94af4cd4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e5be8-9123-4c4b-be49-ba94af4cd4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d1c2ec-9efe-4b3d-bfe7-0ad31d5e0a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d1c2ec-9efe-4b3d-bfe7-0ad31d5e0a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf92f525-47ad-47d4-abf6-ea6543ec3440', 'volume_name': 'volume-cf92f525-47ad-47d4-abf6-ea6543ec3440', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81723dc6-b153-4493-af37-cb8d4e60c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81723dc6-b153-4493-af37-cb8d4e60c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc116d59-88ca-430a-b7ad-445ab0ea64f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume cf92f525-47ad-47d4-abf6-ea6543ec3440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf92f525-47ad-47d4-abf6-ea6543ec3440', 'volume_size': 1} Sep 06 23:06:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:40 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:40 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f 1G Sep 06 23:06:40 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (8fbe306f-52f2-4ab7-87ed-70f627ade575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b1a743-d2fd-4998-9332-deebe8773f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b1a743-d2fd-4998-9332-deebe8773f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793400973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9259a5a5-5019-4c5f-bca9-00d6f1fed71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:40Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b85b6-b03c-4996-956f-0dbc42b58be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b85b6-b03c-4996-956f-0dbc42b58be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f94103-6ab2-4377-8d65-aa54b60b06fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f94103-6ab2-4377-8d65-aa54b60b06fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9259a5a5-5019-4c5f-bca9-00d6f1fed71a', 'volume_name': 'volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d104907c-5987-4b6d-b0df-ec111f0335a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d104907c-5987-4b6d-b0df-ec111f0335a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e416ab-c2fc-4b1d-9142-65f2adec4608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume 9259a5a5-5019-4c5f-bca9-00d6f1fed71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a', 'volume_size': 1} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:40 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f 1G" returned: 0 in 0.540s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba747b7-5e83-471c-9942-a556032986ca -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:40 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba747b7-5e83-471c-9942-a556032986ca -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f Sep 06 23:06:40 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (e67cfff3-4c58-4022-bacb-ed8437c0cbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad90a14b-e97e-4b95-b2de-86a6b611e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad90a14b-e97e-4b95-b2de-86a6b611e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883454877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08047985-4a05-44af-b0c5-d2c2eecb53f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7b322-57a2-4c81-80ec-c32ffad55c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a7b322-57a2-4c81-80ec-c32ffad55c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8827185-bd2a-48e6-bda1-124b52cc664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8827185-bd2a-48e6-bda1-124b52cc664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08047985-4a05-44af-b0c5-d2c2eecb53f5', 'volume_name': 'volume-08047985-4a05-44af-b0c5-d2c2eecb53f5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd754f58-5dec-4e51-9243-2a5f1ba45b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd754f58-5dec-4e51-9243-2a5f1ba45b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930cf0fc-5d52-45b6-95ad-352c762e74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume 08047985-4a05-44af-b0c5-d2c2eecb53f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08047985-4a05-44af-b0c5-d2c2eecb53f5', 'volume_size': 1} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:41 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cba747b7-5e83-471c-9942-a556032986ca -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:41 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f is being set with open permissions: ugo+rw Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:41 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f Sep 06 23:06:41 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (95031a2f-d353-4a63-99ee-3e62ea920654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f95fe9d-a223-4e5a-8e72-d9d0aeb9573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f95fe9d-a223-4e5a-8e72-d9d0aeb9573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012477465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8593b3db-718f-4b5e-8921-c1367e50798b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f901eb48-6f7b-475b-b989-b133624ad29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f901eb48-6f7b-475b-b989-b133624ad29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6a7d45-0ad1-430f-98ea-4c1363d173b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6a7d45-0ad1-430f-98ea-4c1363d173b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8593b3db-718f-4b5e-8921-c1367e50798b', 'volume_name': 'volume-8593b3db-718f-4b5e-8921-c1367e50798b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1b6df0-d005-40db-97a6-3714f8254409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1b6df0-d005-40db-97a6-3714f8254409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e254636e-af46-4658-8b40-8bd72a288418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Volume 8593b3db-718f-4b5e-8921-c1367e50798b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8593b3db-718f-4b5e-8921-c1367e50798b', 'volume_size': 1} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (e0d3469d-fd17-4b22-aad6-c61b096b8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19b4e9c-bd8a-44c5-89fb-678dc0e9f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19b4e9c-bd8a-44c5-89fb-678dc0e9f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752757854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccfa3ef-4373-4328-a183-1a312db11dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b4ffa-7393-41f9-bfc9-856150603e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95b4ffa-7393-41f9-bfc9-856150603e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adf785b-8669-4d20-ab45-09e3c6a11422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adf785b-8669-4d20-ab45-09e3c6a11422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccfa3ef-4373-4328-a183-1a312db11dda', 'volume_name': 'volume-6ccfa3ef-4373-4328-a183-1a312db11dda', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e0497-763d-4f0e-a9f2-12e2961b93a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e0497-763d-4f0e-a9f2-12e2961b93a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba94f384-a75d-408c-ac3d-b1d928e9882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume 6ccfa3ef-4373-4328-a183-1a312db11dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccfa3ef-4373-4328-a183-1a312db11dda', 'volume_size': 1} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:41 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:41 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info Sep 06 23:06:41 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:41 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:41 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info is being set with open permissions: ugo+rw Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:41 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info Sep 06 23:06:41 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:41 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.381s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-528259631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88fe36f-eb84-4488-a4f6-2f329ea0f63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:39Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume b88fe36f-eb84-4488-a4f6-2f329ea0f63b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:42 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:42 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b 1073741824 Sep 06 23:06:42 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5dd36d2b-963f-4855-9119-e59159fcbc96 tempest-CinderUnicodeTest-1310944543 None] Create snapshot completed successfully Sep 06 23:06:42 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b 1073741824" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:42 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b Sep 06 23:06:42 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-2fdbd011-ef2c-4ea5-b322-d3df984c443f-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:42 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-2fdbd011-ef2c-4ea5-b322-d3df984c443f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162229340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf92f525-47ad-47d4-abf6-ea6543ec3440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:40Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume cf92f525-47ad-47d4-abf6-ea6543ec3440 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:42 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7591dd3-72a9-4cd3-83a3-ac34b178b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:42 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 1073741824 Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dce721-d4f2-4a9b-aff1-0d527c24aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:42 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-quobyte-2fdbd011-ef2c-4ea5-b322-d3df984c443f" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b (b88fe36f-eb84-4488-a4f6-2f329ea0f63b): created successfully Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dce721-d4f2-4a9b-aff1-0d527c24aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (a417cde3-b8cb-48f4-89bf-15390b064c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-2fdbd011-ef2c-4ea5-b322-d3df984c443f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Deleting offline snapshot 2fdbd011-ef2c-4ea5-b322-d3df984c443f of volume cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] snapshot_file for this snap is: volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:06:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2b05b58c-745a-4ac1-b337-b791f47026a6 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a88019-29a0-4e6c-939d-c8dc022b68ab]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:43 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f Sep 06 23:06:43 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:43 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cba747b7-5e83-471c-9942-a556032986ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:43 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 1073741824" returned: 0 in 0.569s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[36088749-abee-4aae-847b-308b97c9de4b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:43 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 Sep 06 23:06:43 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:43 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca Sep 06 23:06:43 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:43 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.588s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793400973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9259a5a5-5019-4c5f-bca9-00d6f1fed71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:40Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume 9259a5a5-5019-4c5f-bca9-00d6f1fed71a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:43 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:43 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca" returned: 0 in 0.474s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:43 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a 1073741824 Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:43 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc116d59-88ca-430a-b7ad-445ab0ea64f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf92f525-47ad-47d4-abf6-ea6543ec3440', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e23c0d5-6db8-41b2-8008-c21345db02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:44 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f Sep 06 23:06:44 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 (cf92f525-47ad-47d4-abf6-ea6543ec3440): created successfully Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e23c0d5-6db8-41b2-8008-c21345db02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (6c4564c2-044b-4877-925b-51244ecf7407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fe73b306-7d6b-489f-b350-dbd8fb3fc06d tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:44 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a 1073741824" returned: 0 in 0.534s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:44 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f" returned: 0 in 0.574s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:44 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a Sep 06 23:06:44 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:44 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f Sep 06 23:06:44 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:44 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca.2fdbd011-ef2c-4ea5-b322-d3df984c443f" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:44 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883454877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08047985-4a05-44af-b0c5-d2c2eecb53f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume 08047985-4a05-44af-b0c5-d2c2eecb53f5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:44 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:44 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 1073741824 Sep 06 23:06:44 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e416ab-c2fc-4b1d-9142-65f2adec4608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a55aa60-69f4-419c-abcd-e92558f80841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-2fdbd011-ef2c-4ea5-b322-d3df984c443f" released by "_delete_snapshot" :: held 1.960s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" released by "delete_snapshot" :: held 2.019s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a (9259a5a5-5019-4c5f-bca9-00d6f1fed71a): created successfully Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a55aa60-69f4-419c-abcd-e92558f80841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (8fbe306f-52f2-4ab7-87ed-70f627ade575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7e6b1157-d1c7-43b8-8c04-6b5abb3961d4 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Created reservations ['01cc9214-21ee-4b86-948e-ede4788180b1', '6beaf8bc-7d29-4cc5-8cad-9545d74ea04f', '01ed13a9-1042-4964-bdfe-8383e7ad78d4', 'effbdd73-abde-46a5-b370-e9948be28000'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Delete snapshot completed successfully. Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-442f2d39-58c9-41c4-9792-90cb132a330e tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-2fdbd011-ef2c-4ea5-b322-d3df984c443f-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:45 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 1073741824" returned: 0 in 0.676s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:45 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 Sep 06 23:06:45 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:45 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.650s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012477465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8593b3db-718f-4b5e-8921-c1367e50798b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Creating volume 8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:45 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930cf0fc-5d52-45b6-95ad-352c762e74f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08047985-4a05-44af-b0c5-d2c2eecb53f5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:45 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b 1073741824 Sep 06 23:06:45 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547e972f-0f2a-4c87-9cc9-c4d812d3e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 (08047985-4a05-44af-b0c5-d2c2eecb53f5): created successfully Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547e972f-0f2a-4c87-9cc9-c4d812d3e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (e67cfff3-4c58-4022-bacb-ed8437c0cbe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-399c0bcb-69f4-4a9f-a35c-5b43ac9abdf3 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-cba747b7-5e83-471c-9942-a556032986ca-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-cba747b7-5e83-471c-9942-a556032986ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a717c3c3-0caf-4394-8bc2-d0eda1633cbd]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:46 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca Sep 06 23:06:46 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:46 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b 1073741824" returned: 0 in 0.491s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:46 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b Sep 06 23:06:46 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:46 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:46 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.316s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752757854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccfa3ef-4373-4328-a183-1a312db11dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487646e10e294aa6aaac68ee14e1cc74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:41Z,use_quota=True,user_id='5624bf405002441a8ba0c347ba3609bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:46 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca Sep 06 23:06:46 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Creating volume 6ccfa3ef-4373-4328-a183-1a312db11dda {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e254636e-af46-4658-8b40-8bd72a288418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8593b3db-718f-4b5e-8921-c1367e50798b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af65415c-d3ed-465a-ab38-ea2169694f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:46 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda 1073741824 Sep 06 23:06:46 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Volume volume-8593b3db-718f-4b5e-8921-c1367e50798b (8593b3db-718f-4b5e-8921-c1367e50798b): created successfully Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af65415c-d3ed-465a-ab38-ea2169694f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (95031a2f-d353-4a63-99ee-3e62ea920654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fd13167d-c82e-4581-b2fb-d28021a01b88 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:06:47 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cba747b7-5e83-471c-9942-a556032986ca" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-cba747b7-5e83-471c-9942-a556032986ca" released by "delete_volume" :: held 0.825s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Created reservations ['c74bf88f-d218-4301-a186-12be49ecde93', '60705104-9ed9-4d7c-a460-155b6b074be5', '0b5f531a-39a1-4593-ba25-9ca589968d91', '30e2fa33-0930-4b07-b263-620c110eddae'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:47 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda 1073741824" returned: 0 in 0.520s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:47 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:47 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:47 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-9bf4a370-acc8-409b-9b2a-c3c46456bc37-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:47 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-9bf4a370-acc8-409b-9b2a-c3c46456bc37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "cinder-quobyte-9bf4a370-acc8-409b-9b2a-c3c46456bc37" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-9bf4a370-acc8-409b-9b2a-c3c46456bc37" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4bf6da-1e77-4727-a3c7-fc5df712d070]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:47 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Deleted volume successfully. Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f821e9f9-1acb-41f0-bcbd-db2886a97c12 tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-cba747b7-5e83-471c-9942-a556032986ca-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:47 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 Sep 06 23:06:47 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:47 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.149s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot bf2da23d-c87a-4c64-a797-696d6e884ed4 of volume 8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba94f384-a75d-408c-ac3d-b1d928e9882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccfa3ef-4373-4328-a183-1a312db11dda', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7740d57d-9f0c-499c-8b8c-f4280f4eed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5db50-3242-499f-bb04-b08d90d60f57]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Volume volume-6ccfa3ef-4373-4328-a183-1a312db11dda (6ccfa3ef-4373-4328-a183-1a312db11dda): created successfully Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7740d57d-9f0c-499c-8b8c-f4280f4eed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Flow 'volume_create_manager' (e0d3469d-fd17-4b22-aad6-c61b096b8210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-84804325-6ba7-4402-9574-1317df1b3559 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created volume successfully. Sep 06 23:06:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-6ccfa3ef-4373-4328-a183-1a312db11dda-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-6ccfa3ef-4373-4328-a183-1a312db11dda-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-6ccfa3ef-4373-4328-a183-1a312db11dda" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:48 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b Sep 06 23:06:48 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-6ccfa3ef-4373-4328-a183-1a312db11dda" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:48 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37" returned: 0 in 0.532s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc8b05-c372-4270-ac65-be0e5bd65dc5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:48 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37 Sep 06 23:06:48 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:48 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda Sep 06 23:06:48 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:48 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b" returned: 0 in 0.597s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:48 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 1G Sep 06 23:06:48 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:48 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9bf4a370-acc8-409b-9b2a-c3c46456bc37" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-quobyte-9bf4a370-acc8-409b-9b2a-c3c46456bc37" released by "delete_volume" :: held 1.062s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Created reservations ['053bb6c8-5cf5-448c-9643-6d5a9b2fb1b9', '4085dfa6-851f-4bd6-8a86-bc92c98d1adb', 'd07fb8ff-80a0-4273-847c-8972e74888ae', '9042497c-604d-4c89-a611-7a5e924d254a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:48 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda" returned: 0 in 0.583s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:48 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda Sep 06 23:06:48 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:48 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:48 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:49 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ccfa3ef-4373-4328-a183-1a312db11dda" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 1G" returned: 0 in 0.674s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8593b3db-718f-4b5e-8921-c1367e50798b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-6ccfa3ef-4373-4328-a183-1a312db11dda" released by "delete_volume" :: held 1.042s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Deleted volume successfully. Sep 06 23:06:49 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8593b3db-718f-4b5e-8921-c1367e50798b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 Sep 06 23:06:49 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d6ffc50-b044-46d5-b05f-cceda833dc3c tempest-CinderUnicodeTest-1310944543 None] Lock "cinder-9bf4a370-acc8-409b-9b2a-c3c46456bc37-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['b7e87353-1589-438a-a343-a9f38d3e2aed', 'fb46bb3e-ee0f-4e8f-8898-32d084d1e5b6', 'aeea7003-a115-4b2e-920a-4f0fb9570f5e', '03409478-87d1-4fb3-bfb0-8530842ad32e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:49 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:49 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:49 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8593b3db-718f-4b5e-8921-c1367e50798b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 is being set with open permissions: ugo+rw Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:49 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 Sep 06 23:06:49 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:49 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a337f091-c5ca-4e4e-b6e6-af3c0302c2ad tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-6ccfa3ef-4373-4328-a183-1a312db11dda-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:49 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:49 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info Sep 06 23:06:49 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Flow 'volume_create_manager' (8e5c6a95-23c8-494d-af35-2b0c38ed9b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e26f6a-6c56-4100-8019-e9fac93190d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e26f6a-6c56-4100-8019-e9fac93190d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790108703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5c5330-6ae0-4849-aaa2-5083cb0812bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151a1358ebc04780be9a9aa3d5ee1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:50Z,use_quota=True,user_id='58f41a295e9b43468bd3c6a1a96e9cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7f7afe-c665-407e-a0b5-fde415093d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7f7afe-c665-407e-a0b5-fde415093d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fb401e-43ab-4f7b-92e3-22fc2e0c8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:50 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fb401e-43ab-4f7b-92e3-22fc2e0c8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5c5330-6ae0-4849-aaa2-5083cb0812bd', 'volume_name': 'volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc74a45-7bb8-44b1-bb1b-ee76495be517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc74a45-7bb8-44b1-bb1b-ee76495be517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa09e43-eab4-418c-a1fe-d6e56cd77c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Volume 5b5c5330-6ae0-4849-aaa2-5083cb0812bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd', 'volume_size': 1} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:50 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info is being set with open permissions: ugo+rw Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:50 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info Sep 06 23:06:50 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-08047985-4a05-44af-b0c5-d2c2eecb53f5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-08047985-4a05-44af-b0c5-d2c2eecb53f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:50 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.info" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790108703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5c5330-6ae0-4849-aaa2-5083cb0812bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151a1358ebc04780be9a9aa3d5ee1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:50Z,use_quota=True,user_id='58f41a295e9b43468bd3c6a1a96e9cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Creating volume 5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:50 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:50 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd 1073741824 Sep 06 23:06:50 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-08047985-4a05-44af-b0c5-d2c2eecb53f5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5070ea66-a925-4b68-abdb-25298c7bdbc9 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-08047985-4a05-44af-b0c5-d2c2eecb53f5" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9b572-1068-413c-855c-38e33b22f38e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:50 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 Sep 06 23:06:50 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-bf2da23d-c87a-4c64-a797-696d6e884ed4-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-bf2da23d-c87a-4c64-a797-696d6e884ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-bf2da23d-c87a-4c64-a797-696d6e884ed4" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-bf2da23d-c87a-4c64-a797-696d6e884ed4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot bf2da23d-c87a-4c64-a797-696d6e884ed4 of volume 8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a4297-ccba-4a98-bf09-d82c073b5767]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:50 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:50 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5" returned: 0 in 0.482s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd 1073741824" returned: 0 in 0.623s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5 Sep 06 23:06:51 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:51 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:06:51 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 Sep 06 23:06:51 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-08047985-4a05-44af-b0c5-d2c2eecb53f5" returned: 0 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-08047985-4a05-44af-b0c5-d2c2eecb53f5" released by "delete_volume" :: held 0.853s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:51 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:51 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8593b3db-718f-4b5e-8921-c1367e50798b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa09e43-eab4-418c-a1fe-d6e56cd77c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8a0ad6-bcba-4758-a810-f2a1fb8f0fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc8d7d-3f01-4212-b0b0-734724f54f66]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Volume volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd (5b5c5330-6ae0-4849-aaa2-5083cb0812bd): created successfully Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8a0ad6-bcba-4758-a810-f2a1fb8f0fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Flow 'volume_create_manager' (8e5c6a95-23c8-494d-af35-2b0c38ed9b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['c670296d-f54f-4c42-874f-f43c63923216', '6caeb05f-ba14-412e-8f57-a38575f76965', 'eb4e2edf-1cea-4dbb-9817-0366460fdaff', 'cdda806f-6768-4a54-8037-5c604d070ef4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-04a0bc76-b686-49b9-a995-76c79a9dd345 tempest-SnapshotDependencyTests-11687148 None] Created volume successfully. Sep 06 23:06:51 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b Sep 06 23:06:51 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:51 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:51 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:51 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:51 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 Sep 06 23:06:51 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:06:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6d8d7576-7181-45d6-b215-d76a38a90b5d tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-08047985-4a05-44af-b0c5-d2c2eecb53f5-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:52 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:52 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4 Sep 06 23:06:52 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Creating offline snapshot 3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 of volume 5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650a37e-39d5-4a2a-9c40-da9cdc90d999]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:52 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:06:52 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:52 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b.bf2da23d-c87a-4c64-a797-696d6e884ed4" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-9259a5a5-5019-4c5f-bca9-00d6f1fed71a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-9259a5a5-5019-4c5f-bca9-00d6f1fed71a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-bf2da23d-c87a-4c64-a797-696d6e884ed4" released by "_delete_snapshot" :: held 1.759s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" released by "delete_snapshot" :: held 1.801s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[597fbb0b-af17-4852-92bc-920ba41de596]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Created reservations ['cf789bce-0f7a-47b5-8e32-6d0a79063d30', '03a73aa4-4e04-4307-9264-d969728af97f', '8981eece-1d53-4316-bc56-4fb6fcac13b5', '4cb8e691-a0fa-4abb-84e0-1c8d679c72ec'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:52 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:52 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 1G Sep 06 23:06:52 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:06:52 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a Sep 06 23:06:52 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a060471c-1c4f-4312-b974-1aceddcb3537 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-bf2da23d-c87a-4c64-a797-696d6e884ed4-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-8593b3db-718f-4b5e-8921-c1367e50798b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-8593b3db-718f-4b5e-8921-c1367e50798b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8052d4d5-59a3-4c81-b0b9-b420c9fc841b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a Sep 06 23:06:53 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b Sep 06 23:06:53 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 1G" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:06:53 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-9259a5a5-5019-4c5f-bca9-00d6f1fed71a" released by "delete_volume" :: held 0.860s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:53 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['1e71b82d-2788-49d5-af13-cb41ae634d4e', 'd3731b35-fd88-496b-93d1-baa8506fcd02', '810f8e25-55eb-4c0f-a4c1-08b507a02dfc', '1bac0ca8-d57e-453f-859e-a530e0b9d69b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:53 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b Sep 06 23:06:53 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:53 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 is being set with open permissions: ugo+rw Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:06:53 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:53 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:53 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:53 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8593b3db-718f-4b5e-8921-c1367e50798b" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-8593b3db-718f-4b5e-8921-c1367e50798b" released by "delete_volume" :: held 0.837s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:54 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:54 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:06:54 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info Sep 06 23:06:54 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Created reservations ['80c22deb-20e9-4c00-b360-59bed09b2cf6', 'efae0247-dec5-4445-90b4-ac2575735620', '7acd8c2c-2891-44fb-9e7a-e34bcc416efd', 'bcf20ace-099c-45a3-8f14-8cc258d9e7fb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ab28b78-d50d-40d5-9cf2-8c751161ac28 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-9259a5a5-5019-4c5f-bca9-00d6f1fed71a-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:54 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:54 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:54 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info is being set with open permissions: ugo+rw Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:54 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info Sep 06 23:06:54 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:54 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bf1fbf6f-862a-4a7b-a469-6554bcb35d31 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-8593b3db-718f-4b5e-8921-c1367e50798b-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:54 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.info" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-474165fe-43d2-4d10-884d-4421d800e02d tempest-SnapshotDependencyTests-11687148 None] Create snapshot completed successfully Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (b964b3e7-30e4-46fa-95bb-de1c016a50a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baba9ea-0a31-4a0d-8ab3-a113edb54c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-cf92f525-47ad-47d4-abf6-ea6543ec3440-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baba9ea-0a31-4a0d-8ab3-a113edb54c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542498001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:55Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709d058d-9266-4510-a533-b08e80debee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709d058d-9266-4510-a533-b08e80debee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3337a3-3881-40c4-99c9-cebee7f02308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3337a3-3881-40c4-99c9-cebee7f02308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3', 'volume_name': 'volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3561d1fd-8479-4210-8f99-744276b2b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3561d1fd-8479-4210-8f99-744276b2b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee881ce4-3a0b-4cd8-a5d7-ddacaf613397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Volume cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3', 'volume_size': 1} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542498001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:55Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Creating volume cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:54 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-cf92f525-47ad-47d4-abf6-ea6543ec3440-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:54 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 1073741824 Sep 06 23:06:54 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-cf92f525-47ad-47d4-abf6-ea6543ec3440" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-cf92f525-47ad-47d4-abf6-ea6543ec3440" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9073b3aa-b495-4035-85d9-8db0d94af8b6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:55 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 Sep 06 23:06:55 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:55 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 1073741824" returned: 0 in 0.491s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:55 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:55 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440 Sep 06 23:06:55 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:55 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 Sep 06 23:06:55 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:55 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee881ce4-3a0b-4cd8-a5d7-ddacaf613397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:55 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb6d0d-7e25-4213-b7bd-c7504d214ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cf92f525-47ad-47d4-abf6-ea6543ec3440" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-cf92f525-47ad-47d4-abf6-ea6543ec3440" released by "delete_volume" :: held 0.833s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Volume volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 (cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3): created successfully Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb6d0d-7e25-4213-b7bd-c7504d214ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (b964b3e7-30e4-46fa-95bb-de1c016a50a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6bdff2ef-ff60-410c-a23f-8638dbd5bc80 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:06:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['02057274-c5cc-4bd5-8e09-7d756fb2d82b', '2ba5ab49-f520-4d51-8c83-dd4ab81daab0', '6ceda548-6d1c-4b95-bc5b-d29cd20df000', '6c178705-9ee3-46ec-8b3a-55a36eb0c73e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:56 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:56 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:56 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0eb5a0dc-ba5b-4950-8d1c-ec4c71015e63 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-cf92f525-47ad-47d4-abf6-ea6543ec3440-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Flow 'volume_create_manager' (19137a46-a08d-4d3d-8e63-eecd90dcecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09cb7ad-bb38-4187-88d9-0e8d74c00837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09cb7ad-bb38-4187-88d9-0e8d74c00837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faae6de3-37ed-4062-8728-37835597a9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151a1358ebc04780be9a9aa3d5ee1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3621cd3a-c24f-4f0e-84e3-51bfba8f3d93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:06:56Z,use_quota=True,user_id='58f41a295e9b43468bd3c6a1a96e9cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7929c76b-6888-4dda-91ed-a6c9e346c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7929c76b-6888-4dda-91ed-a6c9e346c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6d7f98-20ea-4946-9aa1-11f6892be941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6d7f98-20ea-4946-9aa1-11f6892be941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'faae6de3-37ed-4062-8728-37835597a9c2', 'volume_name': 'volume-faae6de3-37ed-4062-8728-37835597a9c2', 'volume_size': 1, 'snapshot_id': '3621cd3a-c24f-4f0e-84e3-51bfba8f3d93'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d6407-0fb7-41a3-bf6f-3a4c1ac4f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d6407-0fb7-41a3-bf6f-3a4c1ac4f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3162cd6a-a938-4132-bf0a-c00c7ae4afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:06:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Volume faae6de3-37ed-4062-8728-37835597a9c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-faae6de3-37ed-4062-8728-37835597a9c2', 'volume_size': 1, 'snapshot_id': '3621cd3a-c24f-4f0e-84e3-51bfba8f3d93'} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-faae6de3-37ed-4062-8728-37835597a9c2" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-faae6de3-37ed-4062-8728-37835597a9c2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Creating volume faae6de3-37ed-4062-8728-37835597a9c2 from snapshot 3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] snapshot: 3621cd3a-c24f-4f0e-84e3-51bfba8f3d93, volume: faae6de3-37ed-4062-8728-37835597a9c2, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9fac01-19c7-47e3-9a14-62ee7b1700a3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:56 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:06:56 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:57 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6ef3a-8723-4f90-9b2b-101be8501b20]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-b88fe36f-eb84-4488-a4f6-2f329ea0f63b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-b88fe36f-eb84-4488-a4f6-2f329ea0f63b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:57 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:06:57 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa937a-4ea2-405c-a8dd-372f42d915ec]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:57 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b Sep 06 23:06:57 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:57 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Path /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:57 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 Sep 06 23:06:57 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:57 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:57 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b Sep 06 23:06:57 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:57 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-b88fe36f-eb84-4488-a4f6-2f329ea0f63b" released by "delete_volume" :: held 0.673s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['646a4bc7-88ed-4906-a1b9-45d39cfe7641', '3db7df49-e49f-41dd-9936-fd41030a3f9b', '69198187-87bc-48e5-ab02-51309e2762b5', 'd0786fb1-3417-456b-9ed8-ef059e407204'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:58 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:06:58 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-07655fdd-9283-401b-980f-ca999aed21b3-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-07655fdd-9283-401b-980f-ca999aed21b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-07655fdd-9283-401b-980f-ca999aed21b3" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:06:58 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.633s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-07655fdd-9283-401b-980f-ca999aed21b3" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleting offline snapshot 07655fdd-9283-401b-980f-ca999aed21b3 of volume abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] snapshot_file for this snap is: volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:06:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab76e17c-7cab-45e1-bb64-1c1fe2d464ea]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-073a184b-06fb-4af0-9cba-25d12101109a tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-b88fe36f-eb84-4488-a4f6-2f329ea0f63b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:06:58 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 Sep 06 23:06:58 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:06:59 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 06 23:06:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3" returned: 0 in 0.652s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:06:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:06:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[974c2941-17cd-4b51-a7c1-0c1379420e29]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:06:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:06:59 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 Sep 06 23:06:59 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:00 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0" returned: 0 in 0.750s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:00 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 Sep 06 23:07:00 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:01 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3" returned: 0 in 0.741s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:01 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3 Sep 06 23:07:01 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:01 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0.07655fdd-9283-401b-980f-ca999aed21b3" returned: 0 in 0.617s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-07655fdd-9283-401b-980f-ca999aed21b3" released by "_delete_snapshot" :: held 3.058s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" released by "delete_snapshot" :: held 3.136s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['b388c79a-5136-424c-8ba0-eb38b3986e7d', 'aa823542-329a-4d78-986e-a1d77db1df3f', 'd9e84104-d4d7-4029-a450-b3c3621c4b44', '6d26ad41-e707-49ba-927e-de439440c506'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Delete snapshot completed successfully. Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0399ff13-7ba5-4276-b300-fc4a7d515583 tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-07655fdd-9283-401b-980f-ca999aed21b3-delete_snapshot" released by "delete_snapshot" :: held 3.459s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:02 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2" returned: 0 in 4.658s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 23:07:02 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Converted 1024.00 MB image at 219.78 MB/s Sep 06 23:07:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 is being set with open permissions: ugo+rw Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:02 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 Sep 06 23:07:02 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:02 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" released by "_copy_volume_from_snapshot" :: held 5.791s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-faae6de3-37ed-4062-8728-37835597a9c2" released by "_create_volume_from_snapshot" :: held 5.849s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.869s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.262s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot 3fb84ce3-b830-429d-8ace-2e89ddd534db of volume cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3162cd6a-a938-4132-bf0a-c00c7ae4afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faae6de3-37ed-4062-8728-37835597a9c2', 'volume_size': 1, 'snapshot_id': '3621cd3a-c24f-4f0e-84e3-51bfba8f3d93'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf160c-639a-425a-9f73-b420e6c687c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7374b2db-f554-4b9a-9e27-841f5415e164]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Volume volume-faae6de3-37ed-4062-8728-37835597a9c2 (faae6de3-37ed-4062-8728-37835597a9c2): created successfully Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf160c-639a-425a-9f73-b420e6c687c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Flow 'volume_create_manager' (19137a46-a08d-4d3d-8e63-eecd90dcecb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-66798f10-64b5-4844-b639-1c1d04b56cf9 tempest-SnapshotDependencyTests-11687148 None] Created volume successfully. Sep 06 23:07:02 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 Sep 06 23:07:02 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:02 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:02 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db 1G Sep 06 23:07:02 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-abaed396-eb45-4fb5-8e49-86e40df8fdf0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-abaed396-eb45-4fb5-8e49-86e40df8fdf0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4f026-c516-4056-8f2b-7ebba655fcff]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Deleting offline snapshot 3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 of volume 5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] snapshot_file for this snap is: volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c461ce4-1e97-4a33-a824-396e21256af9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 Sep 06 23:07:03 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db 1G" returned: 0 in 0.492s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db Sep 06 23:07:03 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:07:03 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0 Sep 06 23:07:03 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db is being set with open permissions: ugo+rw Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:03 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db Sep 06 23:07:03 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f5b625-7275-44be-86de-3abea7aa4c47]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:07:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-abaed396-eb45-4fb5-8e49-86e40df8fdf0" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-quobyte-abaed396-eb45-4fb5-8e49-86e40df8fdf0" released by "delete_volume" :: held 0.720s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Created reservations ['5a5df9d0-f1b8-47a4-9140-04015e964cdc', '72543007-9784-4ff0-8f60-ae7bcc521d15', '59accd6a-01f5-4d06-a793-f38feefdbefa', '0b4d2604-a8b0-4871-a54c-13e220ca294e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:03 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info Sep 06 23:07:03 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:03 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:03 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:04 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info is being set with open permissions: ugo+rw Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:04 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info Sep 06 23:07:04 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:04 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:04 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Deleted volume successfully. Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.612s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9ea3a9-2d3e-4e19-afc5-41db79a0f8ae tempest-CreateVolumesFromSnapshotTest-863729609 None] Lock "cinder-abaed396-eb45-4fb5-8e49-86e40df8fdf0-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:04 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:07:04 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:04 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.info" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e256fe3c-4963-459f-b928-e95b8a6a05e6 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:04 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:04 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93 Sep 06 23:07:04 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:04 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd.3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93" released by "_delete_snapshot" :: held 1.720s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" released by "delete_snapshot" :: held 1.741s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Created reservations ['367b6500-6638-4d6b-9452-e4d2403f3159', '92156745-5dd5-4091-b7c6-d2352cd86c35', '603c7864-08ff-45e2-ad7d-80ad15fd0940', 'ebc6bca0-0fda-4c10-a5ae-fa79be5cbd9d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Delete snapshot completed successfully. Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3c871556-5f0a-49a6-aac0-a83ff149daee tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-3621cd3a-c24f-4f0e-84e3-51bfba8f3d93-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-5b5c5330-6ae0-4849-aaa2-5083cb0812bd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-5b5c5330-6ae0-4849-aaa2-5083cb0812bd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[65106b10-ef52-4a62-a83f-c5aa163e7519]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-3fb84ce3-b830-429d-8ace-2e89ddd534db-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:05 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:05 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:05 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:07:05 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3fb84ce3-b830-429d-8ace-2e89ddd534db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-3fb84ce3-b830-429d-8ace-2e89ddd534db" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3fb84ce3-b830-429d-8ace-2e89ddd534db" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot 3fb84ce3-b830-429d-8ace-2e89ddd534db of volume cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf29c4-2973-4696-be07-05b6e8ba812d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:05 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db Sep 06 23:07:05 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:05 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:07:06 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:06 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd Sep 06 23:07:06 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:06 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23fd775-ef08-4aeb-af40-73ace1aca890]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:06 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-5b5c5330-6ae0-4849-aaa2-5083cb0812bd" released by "delete_volume" :: held 0.772s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:06 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 Sep 06 23:07:06 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Created reservations ['19eada14-0dcb-4538-a281-531a3b84fb1f', '12902056-4d79-481d-9569-f8802ac6d0eb', 'da3dabb9-b1c9-442b-a2a1-2093f9cfb261', '3734f3b0-f11f-4040-b071-57aa5a82b5b6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:06 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:06 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db Sep 06 23:07:06 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:06 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:06 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:06 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:07 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db Sep 06 23:07:07 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:07 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Deleted volume successfully. Sep 06 23:07:07 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3.3fb84ce3-b830-429d-8ace-2e89ddd534db" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3fb84ce3-b830-429d-8ace-2e89ddd534db" released by "_delete_snapshot" :: held 1.508s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" released by "delete_snapshot" :: held 1.535s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-58cae4f8-865c-4ab6-8986-8cd20b1bfd05 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-5b5c5330-6ae0-4849-aaa2-5083cb0812bd-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Created reservations ['676d93a6-3575-4b0e-9ba4-f2c36541754f', 'a4f26d72-5262-41db-88d3-25f7998cdd30', '50514149-3beb-4994-92a5-27bdfc6cc4ae', 'f649e366-4b7a-4a2c-b7ea-9af9b4603bca'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-faae6de3-37ed-4062-8728-37835597a9c2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-faae6de3-37ed-4062-8728-37835597a9c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f2fd8ae-05c4-4540-8491-5c3dcf55490a tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3fb84ce3-b830-429d-8ace-2e89ddd534db-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[127748d0-1b45-4be5-8c5d-63262914d4d1]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:08 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 Sep 06 23:07:08 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:08 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:08 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2 Sep 06 23:07:08 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:08 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-faae6de3-37ed-4062-8728-37835597a9c2" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-quobyte-faae6de3-37ed-4062-8728-37835597a9c2" released by "delete_volume" :: held 0.655s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Created reservations ['1be7a32f-1139-496a-8a0a-0314c3857766', '743abbdf-0f96-469e-9984-5fb5aa8ced2d', '0f9f4dd0-d42c-43d6-bceb-5ea0e13e9238', '2981b6ac-bac4-4873-ae98-6a46d658f596'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "cinder-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" acquired by "delete_volume" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f32fde3-d323-4a7b-ab20-4906713b7c3a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:09 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:09 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:09 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 Sep 06 23:07:09 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:09 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Deleted volume successfully. Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b7d1b338-2b81-4a43-a4a9-61b31fb25aa3 tempest-SnapshotDependencyTests-11687148 None] Lock "cinder-faae6de3-37ed-4062-8728-37835597a9c2-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:09 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:09 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3 Sep 06 23:07:09 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:10 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3" released by "delete_volume" :: held 0.726s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Created reservations ['71448e4f-d828-4a0a-8160-70c290ad125e', '57ad40ca-6123-4415-a5f2-0698d539d8f7', '31abfee9-4915-4e32-ace5-a7f340f28be9', '212145a8-3237-4b84-b57c-c5c7b6bd1d3d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:10 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:10 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (39312298-ccf5-44f8-b93f-28442b332221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e557a9-6422-476a-b948-2e5decd53157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e557a9-6422-476a-b948-2e5decd53157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306265721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3aa171-426c-4d99-b244-c1797355283f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:10Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16460243-35b2-48d0-8eec-4e4715edce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16460243-35b2-48d0-8eec-4e4715edce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9d806e-e6f3-4836-b05a-4b6730f5908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9d806e-e6f3-4836-b05a-4b6730f5908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3aa171-426c-4d99-b244-c1797355283f', 'volume_name': 'volume-7f3aa171-426c-4d99-b244-c1797355283f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c34870-051a-4194-824e-379e30bcd855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c34870-051a-4194-824e-379e30bcd855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf9ad68-548c-4f24-b1c5-698e6ac94ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Volume 7f3aa171-426c-4d99-b244-c1797355283f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3aa171-426c-4d99-b244-c1797355283f', 'volume_size': 1} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306265721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3aa171-426c-4d99-b244-c1797355283f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:10Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Creating volume 7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:10 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f 1073741824 Sep 06 23:07:10 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:10 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-db299598-837d-4a07-bba1-3b244a789bff tempest-ProjectMemberTests-1186030494 None] Lock "cinder-cd12b74f-9dad-423c-8cbb-f82c5ccf4aa3-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (ac51b096-2b35-4e5f-9f48-2b63cbdc1f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf733c-1ce4-4790-99b5-870ad9748d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf733c-1ce4-4790-99b5-870ad9748d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960324668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3390c1f8-8b59-49d8-86a3-c05b064b0b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:11Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:10 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b33ae-5c93-4778-bdba-c5f15cb7a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b33ae-5c93-4778-bdba-c5f15cb7a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9d76f2-05ec-4a55-8dac-7fdb957999d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9d76f2-05ec-4a55-8dac-7fdb957999d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3390c1f8-8b59-49d8-86a3-c05b064b0b0f', 'volume_name': 'volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c2f13-46b4-4af4-bc46-122b7800d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c2f13-46b4-4af4-bc46-122b7800d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ed6297-e7ea-4b05-b155-647254aad2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Volume 3390c1f8-8b59-49d8-86a3-c05b064b0b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f', 'volume_size': 1} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f 1073741824" returned: 0 in 0.570s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:11 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f Sep 06 23:07:11 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:11 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960324668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3390c1f8-8b59-49d8-86a3-c05b064b0b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:11Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Creating volume 3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf9ad68-548c-4f24-b1c5-698e6ac94ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3aa171-426c-4d99-b244-c1797355283f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7addcb4-fcf6-4530-bd47-c1cd2e8aed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:11 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f 1073741824 Sep 06 23:07:11 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Volume volume-7f3aa171-426c-4d99-b244-c1797355283f (7f3aa171-426c-4d99-b244-c1797355283f): created successfully Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7addcb4-fcf6-4530-bd47-c1cd2e8aed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (39312298-ccf5-44f8-b93f-28442b332221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-55c702f3-c89a-4107-8075-1619ed5cdb8c tempest-ProjectReaderTests-676931063 None] Created volume successfully. Sep 06 23:07:11 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f 1073741824" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:11 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f Sep 06 23:07:11 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:12 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ed6297-e7ea-4b05-b155-647254aad2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6745ba-78db-4749-973a-6e8d2294b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Volume volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f (3390c1f8-8b59-49d8-86a3-c05b064b0b0f): created successfully Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6745ba-78db-4749-973a-6e8d2294b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (ac51b096-2b35-4e5f-9f48-2b63cbdc1f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-960c9cbe-24cd-47b9-9bcf-a7bcb7ba9ed0 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Creating offline snapshot d2a4e13e-9306-4a75-890c-0b616ec6afea of volume 7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc75b37-bb4f-47d5-8576-0021d36809b8]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:12 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f Sep 06 23:07:12 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:13 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f" returned: 0 in 0.402s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:13 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea 1G Sep 06 23:07:13 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:13 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea 1G" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f3aa171-426c-4d99-b244-c1797355283f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:13 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f3aa171-426c-4d99-b244-c1797355283f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea Sep 06 23:07:13 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:13 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f3aa171-426c-4d99-b244-c1797355283f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:13 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea is being set with open permissions: ugo+rw Sep 06 23:07:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:13 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea Sep 06 23:07:13 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:14 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:14 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info Sep 06 23:07:14 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:14 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info is being set with open permissions: ugo+rw Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:14 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info Sep 06 23:07:14 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:14 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.info" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.472s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot e99f7411-545e-4f84-9da2-34e7d0f9adb7 of volume 3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5dbf6ed3-f2f2-47c3-a98b-b65aa276174d tempest-ProjectReaderTests-676931063 None] Create snapshot completed successfully Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a7482-0652-47da-9f3f-c55b549fdceb]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:14 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f Sep 06 23:07:14 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:15 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:15 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 1G Sep 06 23:07:15 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:15 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 1G" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:15 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 Sep 06 23:07:15 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:15 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 is being set with open permissions: ugo+rw Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-d2a4e13e-9306-4a75-890c-0b616ec6afea-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:15 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 Sep 06 23:07:15 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-d2a4e13e-9306-4a75-890c-0b616ec6afea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-d2a4e13e-9306-4a75-890c-0b616ec6afea" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d2a4e13e-9306-4a75-890c-0b616ec6afea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Deleting offline snapshot d2a4e13e-9306-4a75-890c-0b616ec6afea of volume 7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] snapshot_file for this snap is: volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec35fad-0b58-475b-8f15-b72f2a5c8f4e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:16 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea Sep 06 23:07:16 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:16 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:16 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info Sep 06 23:07:16 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:16 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f3aa171-426c-4d99-b244-c1797355283f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7467a4b-a278-44c3-8995-95e21050d318]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:16 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:16 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info is being set with open permissions: ugo+rw Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:16 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info Sep 06 23:07:16 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:16 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f Sep 06 23:07:16 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:16 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.info" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d5481aa-d195-4d01-a6a3-ed12f35104e0 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:16 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:16 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea Sep 06 23:07:16 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:17 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:17 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea Sep 06 23:07:17 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-e99f7411-545e-4f84-9da2-34e7d0f9adb7-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-e99f7411-545e-4f84-9da2-34e7d0f9adb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-e99f7411-545e-4f84-9da2-34e7d0f9adb7" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-e99f7411-545e-4f84-9da2-34e7d0f9adb7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot e99f7411-545e-4f84-9da2-34e7d0f9adb7 of volume 3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb7f0c-1105-4983-913d-1698f2792a77]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:17 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f.d2a4e13e-9306-4a75-890c-0b616ec6afea" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d2a4e13e-9306-4a75-890c-0b616ec6afea" released by "_delete_snapshot" :: held 1.576s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:17 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 Sep 06 23:07:17 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" released by "delete_snapshot" :: held 1.599s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Created reservations ['9132e610-2046-4b6c-8bf0-1a9c37364cd8', '55858396-d59f-4804-a658-dcfaab30d7e7', '8375ec1f-6c56-4a82-a13e-f1f5362e5341', 'e9b34834-dd78-407c-9b87-7d7775ebef67'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Delete snapshot completed successfully. Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f5833523-99f1-4267-9ae1-1e4e8a5b5708 tempest-ProjectReaderTests-676931063 None] Lock "cinder-d2a4e13e-9306-4a75-890c-0b616ec6afea-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:17 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b6e5e-402a-489e-9eae-e2375fc0e6c2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:18 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f Sep 06 23:07:18 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-7f3aa171-426c-4d99-b244-c1797355283f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "cinder-7f3aa171-426c-4d99-b244-c1797355283f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d8a10-de54-42fc-8c2b-42460b6e9277]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:18 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:18 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 Sep 06 23:07:18 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:18 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f Sep 06 23:07:18 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:18 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:18 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f Sep 06 23:07:18 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:18 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:18 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7 Sep 06 23:07:18 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:19 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7f3aa171-426c-4d99-b244-c1797355283f" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-7f3aa171-426c-4d99-b244-c1797355283f" released by "delete_volume" :: held 0.763s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:19 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f.e99f7411-545e-4f84-9da2-34e7d0f9adb7" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Created reservations ['7ec7c082-765f-4f37-b61c-ce5082c587d2', '31803e6b-5d52-4d92-84e9-ab3567e7cadb', 'efbc3ee4-3001-49f8-b489-294e0e69cd01', 'caea49f5-06f4-40aa-8249-05017062382b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-e99f7411-545e-4f84-9da2-34e7d0f9adb7" released by "_delete_snapshot" :: held 1.709s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" released by "delete_snapshot" :: held 1.734s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:19 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Created reservations ['376475fc-3e6c-46a9-956a-1ef9af5e63db', '89c2b0c0-7a25-4970-8b31-ad334054b938', '27c203f8-08c5-4c8a-975c-8b37cfd6907e', '9dddc637-7d27-4d37-b39d-85f9430d006a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:19 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-71fc5338-6130-46e2-93bb-4d90c54ed087 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-e99f7411-545e-4f84-9da2-34e7d0f9adb7-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-3390c1f8-8b59-49d8-86a3-c05b064b0b0f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3390c1f8-8b59-49d8-86a3-c05b064b0b0f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:19 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Deleted volume successfully. Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9d92e156-5b42-4d42-b5f8-ab19f923401c tempest-ProjectReaderTests-676931063 None] Lock "cinder-7f3aa171-426c-4d99-b244-c1797355283f-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c046f8-ca93-47bc-9f0b-2fe9d19c3e28]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:19 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f Sep 06 23:07:19 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (28936e49-1f2d-4a82-9e05-f3e2d85c5434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d69217-7ef0-4756-aa67-99d37ab8a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d69217-7ef0-4756-aa67-99d37ab8a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842809140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad041d0-89f7-4dcd-a302-2a3a14b6836b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:20Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af755bea-76f4-437f-9842-a872beff6253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af755bea-76f4-437f-9842-a872beff6253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210e7afe-8dba-4691-92ec-607364636705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210e7afe-8dba-4691-92ec-607364636705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad041d0-89f7-4dcd-a302-2a3a14b6836b', 'volume_name': 'volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8ee5ed-7281-4040-9d21-723ca3d6adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8ee5ed-7281-4040-9d21-723ca3d6adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94277650-9469-4e71-acb9-7f37764d36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Volume 5ad041d0-89f7-4dcd-a302-2a3a14b6836b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b', 'volume_size': 1} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842809140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad041d0-89f7-4dcd-a302-2a3a14b6836b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:20Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Creating volume 5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:20 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:20 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b 1073741824 Sep 06 23:07:20 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:20 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:20 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f Sep 06 23:07:20 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:20 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-3390c1f8-8b59-49d8-86a3-c05b064b0b0f" released by "delete_volume" :: held 0.819s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Created reservations ['4add5e65-02c3-4afe-871b-fc79ea7c7d4b', '8f97afc0-aa23-42ec-a5ab-8b7d865d08aa', 'bd2ed900-76c7-4c0e-ad0f-de1acbccf947', '06cd934e-5286-46e5-b649-43b86b71e8e0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:20 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b 1073741824" returned: 0 in 0.523s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:20 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b Sep 06 23:07:20 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:20 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:20 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:21 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" returned: 0 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94277650-9469-4e71-acb9-7f37764d36aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75a33b-05d2-47e6-8ad2-c9edaed15394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Volume volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b (5ad041d0-89f7-4dcd-a302-2a3a14b6836b): created successfully Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75a33b-05d2-47e6-8ad2-c9edaed15394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (28936e49-1f2d-4a82-9e05-f3e2d85c5434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-43695485-eca4-4e95-b69a-406d949ff0b7 tempest-ProjectReaderTests-676931063 None] Created volume successfully. Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73c22efc-b26d-4a1a-928e-3be6f016b602 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-3390c1f8-8b59-49d8-86a3-c05b064b0b0f-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (a6ea30a9-ed1f-4a13-8d37-282140407169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808cb82d-ea28-4f5c-bc3b-c89bdae1c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808cb82d-ea28-4f5c-bc3b-c89bdae1c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284821600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0baaf5-4962-4e06-9a7a-e3de4a87ef34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:21Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ad965b-54bd-49e3-ab7f-6a7ae3ace061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ad965b-54bd-49e3-ab7f-6a7ae3ace061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f41f5e-dccf-4c5c-9de4-aab595e826a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f41f5e-dccf-4c5c-9de4-aab595e826a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0baaf5-4962-4e06-9a7a-e3de4a87ef34', 'volume_name': 'volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4618ea61-c840-47b2-af80-3ccacb2a87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4618ea61-c840-47b2-af80-3ccacb2a87c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbce3da-01cb-4a6b-b85c-e4ae091f2f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Volume ae0baaf5-4962-4e06-9a7a-e3de4a87ef34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34', 'volume_size': 1} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284821600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0baaf5-4962-4e06-9a7a-e3de4a87ef34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:21Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Creating volume ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:21 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 1073741824 Sep 06 23:07:21 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:21 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 1073741824" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:21 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 Sep 06 23:07:21 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:22 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbce3da-01cb-4a6b-b85c-e4ae091f2f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfec558d-d2e5-4afc-95b0-ce4d0eb67525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Volume volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 (ae0baaf5-4962-4e06-9a7a-e3de4a87ef34): created successfully Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfec558d-d2e5-4afc-95b0-ce4d0eb67525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (a6ea30a9-ed1f-4a13-8d37-282140407169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7adfb9a1-3f46-4550-a3e5-9bb0e1c3073c tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Creating offline snapshot c7eb0eea-7a6c-4694-82b6-2b98bf787163 of volume 5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e9c980-9141-4bf8-ba01-2d2baac5885d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:22 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b Sep 06 23:07:22 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:22 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:22 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 1G Sep 06 23:07:22 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:23 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 1G" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:23 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 Sep 06 23:07:23 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:23 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:23 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 is being set with open permissions: ugo+rw Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:23 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 Sep 06 23:07:23 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:23 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:23 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info Sep 06 23:07:23 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:23 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:23 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info is being set with open permissions: ugo+rw Sep 06 23:07:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:23 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info Sep 06 23:07:23 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:24 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.info" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.557s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot b2020111-e13e-4e8a-a35c-3d1290529b72 of volume ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a95a7b1f-723b-4a3e-8e91-7b678e2b9a4e tempest-ProjectReaderTests-676931063 None] Create snapshot completed successfully Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d935208-3669-42ed-8cce-3877b571deec]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:24 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 Sep 06 23:07:24 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-c7eb0eea-7a6c-4694-82b6-2b98bf787163-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-c7eb0eea-7a6c-4694-82b6-2b98bf787163-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-c7eb0eea-7a6c-4694-82b6-2b98bf787163" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-c7eb0eea-7a6c-4694-82b6-2b98bf787163" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Deleting offline snapshot c7eb0eea-7a6c-4694-82b6-2b98bf787163 of volume 5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] snapshot_file for this snap is: volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d54653-100a-44c2-8ecf-089897b510f8]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:24 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:24 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 1G Sep 06 23:07:24 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:24 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 Sep 06 23:07:24 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:24 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[32925c74-7206-4564-886f-18bd8464f534]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:24 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 1G" returned: 0 in 0.415s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:24 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 Sep 06 23:07:24 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b Sep 06 23:07:25 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 is being set with open permissions: ugo+rw Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:25 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 Sep 06 23:07:25 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:25 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 Sep 06 23:07:25 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:25 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info Sep 06 23:07:25 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163" returned: 0 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:25 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163 Sep 06 23:07:25 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info is being set with open permissions: ugo+rw Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:25 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info Sep 06 23:07:25 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:25 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b.c7eb0eea-7a6c-4694-82b6-2b98bf787163" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-c7eb0eea-7a6c-4694-82b6-2b98bf787163" released by "_delete_snapshot" :: held 1.513s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" released by "delete_snapshot" :: held 1.541s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:26 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.info" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Created reservations ['218d7921-452c-47f0-ab12-1227f41f4318', '08bec4ee-590e-48a0-9be3-2e3eb41c2556', '91a12375-92f1-4737-b2cd-35a81f6bb4dc', '0fff4a23-5f3f-4229-9da8-043ed95ca862'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bf06d37c-cd9d-4151-ab83-5706410358fb tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Delete snapshot completed successfully. Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4559a354-28f0-42e2-b8ce-74c096619aa3 tempest-ProjectReaderTests-676931063 None] Lock "cinder-c7eb0eea-7a6c-4694-82b6-2b98bf787163-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-5ad041d0-89f7-4dcd-a302-2a3a14b6836b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "cinder-5ad041d0-89f7-4dcd-a302-2a3a14b6836b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5ad98b-7e0c-4a3a-9cb7-c3c820f79f0b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-b2020111-e13e-4e8a-a35c-3d1290529b72-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-b2020111-e13e-4e8a-a35c-3d1290529b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-b2020111-e13e-4e8a-a35c-3d1290529b72" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-b2020111-e13e-4e8a-a35c-3d1290529b72" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:26 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot b2020111-e13e-4e8a-a35c-3d1290529b72 of volume ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:26 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e922b-7096-4c2b-819c-d9c75bbfbe4a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:27 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 Sep 06 23:07:27 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:27 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:27 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b Sep 06 23:07:27 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:27 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a81663-2127-4649-b5ce-16f2cc57777c]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:27 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-5ad041d0-89f7-4dcd-a302-2a3a14b6836b" released by "delete_volume" :: held 0.710s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:27 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 Sep 06 23:07:27 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Created reservations ['2c873841-6505-4249-9dba-f85db972f3ff', '7d524132-1cc3-4aaa-a069-d0e8baa3ec5b', '8a094dbe-1129-4cd9-ade2-66bca8acf304', '50d24d97-dfd8-4c4d-944b-2843700597d2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:27 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:27 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:27 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:27 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 Sep 06 23:07:27 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:27 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Deleted volume successfully. Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7b74218c-011a-470b-b943-cd5eeff13689 tempest-ProjectReaderTests-676931063 None] Lock "cinder-5ad041d0-89f7-4dcd-a302-2a3a14b6836b-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:27 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:28 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72 Sep 06 23:07:28 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:28 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34.b2020111-e13e-4e8a-a35c-3d1290529b72" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-b2020111-e13e-4e8a-a35c-3d1290529b72" released by "_delete_snapshot" :: held 1.438s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" released by "delete_snapshot" :: held 1.466s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Created reservations ['c7d02fed-af3a-4d9d-8f65-cdddc18d25fb', 'bcff2a17-6efb-4ea5-92a0-ecf7324db2ba', '7f5f5362-3a4d-4afa-92e7-19e37a305845', '7756d1c9-9697-4a48-9658-2b7b35c8e628'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7d4db451-6071-44f3-ae31-4c26085f7c6f tempest-ProjectMemberTests-1186030494 None] Lock "cinder-b2020111-e13e-4e8a-a35c-3d1290529b72-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (6e22dd02-d141-469b-811e-f67b47cc6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d5ea64-25df-4ba2-84cb-45141ca25bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d5ea64-25df-4ba2-84cb-45141ca25bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786896467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af5fef1-d880-4a48-912f-95db446d6db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:28Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e28baa-9487-498f-8c8d-052f3f496056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e28baa-9487-498f-8c8d-052f3f496056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83563626-a3c2-4dcd-8f0f-7bfc8d16195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83563626-a3c2-4dcd-8f0f-7bfc8d16195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af5fef1-d880-4a48-912f-95db446d6db0', 'volume_name': 'volume-0af5fef1-d880-4a48-912f-95db446d6db0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997e8d14-e6c4-42ce-a73b-5f9480cd1e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997e8d14-e6c4-42ce-a73b-5f9480cd1e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d4767d-f7b9-433b-bfbe-e9e791b2fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Volume 0af5fef1-d880-4a48-912f-95db446d6db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af5fef1-d880-4a48-912f-95db446d6db0', 'volume_size': 1} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786896467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af5fef1-d880-4a48-912f-95db446d6db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:28Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Creating volume 0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:28 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 1073741824 Sep 06 23:07:28 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:29 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 1073741824" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553b59e-8cb5-41df-b0e6-bb9bddcce042]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:29 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 Sep 06 23:07:29 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:29 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 Sep 06 23:07:29 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:29 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d4767d-f7b9-433b-bfbe-e9e791b2fadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af5fef1-d880-4a48-912f-95db446d6db0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a68ea-e6f9-426e-85b7-383d00df29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Volume volume-0af5fef1-d880-4a48-912f-95db446d6db0 (0af5fef1-d880-4a48-912f-95db446d6db0): created successfully Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a68ea-e6f9-426e-85b7-383d00df29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (6e22dd02-d141-469b-811e-f67b47cc6965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-93c27215-3d82-4784-be41-a487a98756bb tempest-ProjectReaderTests-676931063 None] Created volume successfully. Sep 06 23:07:29 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:29 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34 Sep 06 23:07:29 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:29 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Creating offline snapshot fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 of volume 0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f4075-1d2b-4af7-930c-7b34b1f22641]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34" released by "delete_volume" :: held 0.700s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Created reservations ['033355a5-4619-4a0d-b62b-2971e5badade', '8280e570-4d7c-4e53-95fc-a8196d660615', '8da0db06-d7ca-493a-85fe-24d209671600', '54555577-8303-428a-9762-ae98bf1254eb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:29 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 Sep 06 23:07:29 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:29 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:29 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:30 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:30 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:30 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 1G Sep 06 23:07:30 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e323de50-13b5-48ce-be6f-9b8e868f389b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-ae0baaf5-4962-4e06-9a7a-e3de4a87ef34-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:30 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 1G" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af5fef1-d880-4a48-912f-95db446d6db0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:30 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af5fef1-d880-4a48-912f-95db446d6db0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 Sep 06 23:07:30 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (1db49d75-b15e-4c21-8ad4-7cc94936bbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e88dfa-51f6-4c9e-9839-994d6e9e4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e88dfa-51f6-4c9e-9839-994d6e9e4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62209398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a444ec9-9f4f-4248-ab05-cf1ea9c98c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:31Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b9a9c1-7b9e-4d61-9d46-844309d03811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b9a9c1-7b9e-4d61-9d46-844309d03811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac3bf4f-bdd8-4522-bf49-6d9afe3245c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac3bf4f-bdd8-4522-bf49-6d9afe3245c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a444ec9-9f4f-4248-ab05-cf1ea9c98c68', 'volume_name': 'volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a810a3-f371-4aaf-af7d-7254d7ca11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a810a3-f371-4aaf-af7d-7254d7ca11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202aa907-7211-4ff1-b327-87d276f7e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Volume 7a444ec9-9f4f-4248-ab05-cf1ea9c98c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68', 'volume_size': 1} Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:30 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af5fef1-d880-4a48-912f-95db446d6db0 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 is being set with open permissions: ugo+rw Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:30 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 Sep 06 23:07:30 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:30 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:31 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info Sep 06 23:07:31 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:31 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info is being set with open permissions: ugo+rw Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:31 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info Sep 06 23:07:31 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:31 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62209398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a444ec9-9f4f-4248-ab05-cf1ea9c98c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:31Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Creating volume 7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:31 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 1073741824 Sep 06 23:07:31 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0c7fe161-cfd2-49f5-8f02-b4957b9e1bc6 tempest-ProjectReaderTests-676931063 None] Create snapshot completed successfully Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Deleting offline snapshot fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 of volume 0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] snapshot_file for this snap is: volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63dc816-5b31-4693-b0eb-77fad486a746]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:31 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 1073741824" returned: 0 in 0.431s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:32 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 Sep 06 23:07:32 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:32 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 Sep 06 23:07:32 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:32 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0af5fef1-d880-4a48-912f-95db446d6db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:32 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a13101-f894-4329-9b4c-800f6f88de4b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202aa907-7211-4ff1-b327-87d276f7e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2fdc2-6395-4337-9e60-862af7c30c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Volume volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 (7a444ec9-9f4f-4248-ab05-cf1ea9c98c68): created successfully Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2fdc2-6395-4337-9e60-862af7c30c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (1db49d75-b15e-4c21-8ad4-7cc94936bbb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-570e49b6-141e-45d2-a83d-e69135eb260f tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:32 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 Sep 06 23:07:32 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:32 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:32 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 Sep 06 23:07:32 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot 78eab6ef-573a-4acd-ba24-282566604b4e of volume 7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20fb9e8-f1cf-4b8f-8ea9-48217da80fbe]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:32 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 Sep 06 23:07:32 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:33 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:33 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0 Sep 06 23:07:33 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:33 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:33 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0.fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:33 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e 1G Sep 06 23:07:33 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0" released by "_delete_snapshot" :: held 1.427s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" released by "delete_snapshot" :: held 1.451s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Created reservations ['09155748-1622-42ad-b0f9-cba23c8ffe78', '5a7d1a50-0e19-4eb3-9c27-23008018a2c0', '43cc33b9-1ef4-4087-a729-80d69572816a', '927da025-3899-4c8a-8209-bdd1d9f9c460'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Delete snapshot completed successfully. Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9e7c3081-06b9-4354-9b5f-19118fa8f1f2 tempest-ProjectReaderTests-676931063 None] Lock "cinder-fcaf0578-a476-46c9-bdc4-6108bcbd6bb0-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:33 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e 1G" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:33 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e Sep 06 23:07:33 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:33 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:33 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e is being set with open permissions: ugo+rw Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:33 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e Sep 06 23:07:33 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-0af5fef1-d880-4a48-912f-95db446d6db0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "cinder-0af5fef1-d880-4a48-912f-95db446d6db0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc496ac7-384f-4579-95ff-c1bc0592fa28]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:34 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:34 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 Sep 06 23:07:34 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:34 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info Sep 06 23:07:34 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:34 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:34 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info is being set with open permissions: ugo+rw Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:34 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0 Sep 06 23:07:34 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:34 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info Sep 06 23:07:34 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:34 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-0af5fef1-d880-4a48-912f-95db446d6db0" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:34 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.info" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-0af5fef1-d880-4a48-912f-95db446d6db0" released by "delete_volume" :: held 0.691s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-764db2c9-30f8-4fb9-bd55-e584b8a87b87 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Created reservations ['e6919e9d-4584-4218-8bb7-33634e780c40', '0a5d203f-f774-4d62-b3e2-6627adb73bf9', '071ae950-703e-48b2-86a3-e5a8d1f07c49', 'fc390cf5-7aa4-4168-aff3-35661a4985de'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:34 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:34 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-78eab6ef-573a-4acd-ba24-282566604b4e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-78eab6ef-573a-4acd-ba24-282566604b4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-78eab6ef-573a-4acd-ba24-282566604b4e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-78eab6ef-573a-4acd-ba24-282566604b4e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot 78eab6ef-573a-4acd-ba24-282566604b4e of volume 7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5dd17-5617-4595-a8ec-9a4d8cbfdfa3]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:35 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Deleted volume successfully. Sep 06 23:07:35 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e Sep 06 23:07:35 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-837efb50-11b7-4e02-a816-ce2c0646db73 tempest-ProjectReaderTests-676931063 None] Lock "cinder-0af5fef1-d880-4a48-912f-95db446d6db0-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:35 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac42c81-b282-4631-9a1e-ea1e6a4daf2f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:35 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 Sep 06 23:07:35 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (43237cc1-895b-4442-816f-367c38a787ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60fb77d-19f8-4678-b13a-cf42fe85f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60fb77d-19f8-4678-b13a-cf42fe85f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030663274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bba4d3-5b97-4df7-bb1a-78819422becc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:36Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd65b8f-cf9b-4eac-b238-dd7105e86946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd65b8f-cf9b-4eac-b238-dd7105e86946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe47d22-9612-412e-baa7-fe7a8388acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe47d22-9612-412e-baa7-fe7a8388acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95bba4d3-5b97-4df7-bb1a-78819422becc', 'volume_name': 'volume-95bba4d3-5b97-4df7-bb1a-78819422becc', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605bf993-c3e4-4801-93cb-c61f0113a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605bf993-c3e4-4801-93cb-c61f0113a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b658396-86eb-4450-8aec-2f4b03419142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Volume 95bba4d3-5b97-4df7-bb1a-78819422becc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95bba4d3-5b97-4df7-bb1a-78819422becc', 'volume_size': 1} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030663274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bba4d3-5b97-4df7-bb1a-78819422becc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:36Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Creating volume 95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:35 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:35 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc 1073741824 Sep 06 23:07:35 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:35 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:35 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e Sep 06 23:07:35 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:36 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc 1073741824" returned: 0 in 0.444s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:36 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc Sep 06 23:07:36 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:36 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:36 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e Sep 06 23:07:36 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:36 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b658396-86eb-4450-8aec-2f4b03419142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95bba4d3-5b97-4df7-bb1a-78819422becc', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30998a3-05ca-4c17-bebb-3290de54f437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Volume volume-95bba4d3-5b97-4df7-bb1a-78819422becc (95bba4d3-5b97-4df7-bb1a-78819422becc): created successfully Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30998a3-05ca-4c17-bebb-3290de54f437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (43237cc1-895b-4442-816f-367c38a787ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:36 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68.78eab6ef-573a-4acd-ba24-282566604b4e" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f71f06d9-06d5-4a62-80ba-68e9c0eacb9a tempest-ProjectReaderTests-676931063 None] Created volume successfully. Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-78eab6ef-573a-4acd-ba24-282566604b4e" released by "_delete_snapshot" :: held 1.535s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" released by "delete_snapshot" :: held 1.559s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Created reservations ['87a8df69-4fb0-43cb-93ad-044f265b3f92', 'd109dbac-d631-47b3-b0c4-0c01a9d82e4f', 'b899d213-1daa-479f-b7e5-1d0813ce67af', 'f5a872ac-6a97-4260-8f30-7021de39f24d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d2519e31-300d-48f0-9170-2440ae9c5487 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-78eab6ef-573a-4acd-ba24-282566604b4e-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Creating offline snapshot 36ceeb3b-d930-4848-a3ff-ad240bd2edff of volume 95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77abe7c-2bdc-4b13-aef1-783bc1014292]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:37 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc Sep 06 23:07:37 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4650463b-e718-40a4-91bf-4893cec976b4]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:37 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 Sep 06 23:07:37 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:37 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:37 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff 1G Sep 06 23:07:37 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:37 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:37 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68 Sep 06 23:07:37 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:37 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff 1G" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bba4d3-5b97-4df7-bb1a-78819422becc -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:37 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:37 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bba4d3-5b97-4df7-bb1a-78819422becc -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff Sep 06 23:07:37 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68" released by "delete_volume" :: held 0.691s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Created reservations ['9877d8d4-e335-4756-9214-9125098df5d1', '907e6acb-7111-43e7-bdd2-6fc032922e39', '7ec53939-c18f-4d09-b573-53a146758201', '309c65bb-d870-49f9-acc5-6bcbe9c01c10'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:38 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:38 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:38 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95bba4d3-5b97-4df7-bb1a-78819422becc -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff is being set with open permissions: ugo+rw Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:38 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff Sep 06 23:07:38 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:38 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=277,cinder:DELETE=21,cinder:SELECT=201,cinder:INSERT=72 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ef4b3ce3-1b7e-4198-9a29-91aeaa2f29e6 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-7a444ec9-9f4f-4248-ab05-cf1ea9c98c68-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:38 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:38 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info Sep 06 23:07:38 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:38 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info is being set with open permissions: ugo+rw Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=217,cinder:INSERT=75,cinder:UPDATE=278,cinder:DELETE=25 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:07:38 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:38 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (708cae03-6d0e-4a8d-ac36-2a1a204c99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d038b9-0117-402e-b937-4184b30d4c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d038b9-0117-402e-b937-4184b30d4c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075706270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:39Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d432e541-aacc-474e-b4cb-6ad72e0cc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d432e541-aacc-474e-b4cb-6ad72e0cc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2333ab1e-640d-479c-bd7e-96b477ae5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2333ab1e-640d-479c-bd7e-96b477ae5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d', 'volume_name': 'volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8138209d-37a3-44ef-93fc-a9a086c4f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8138209d-37a3-44ef-93fc-a9a086c4f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe0024-30b9-4653-b948-c259bb9e52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Volume 6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d', 'volume_size': 1} Sep 06 23:07:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:39 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.info" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075706270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:39Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Creating volume 6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:39 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:39 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d 1073741824 Sep 06 23:07:39 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6524d37d-ec9d-4200-8f65-4bc961efbc9c tempest-ProjectReaderTests-676931063 None] Create snapshot completed successfully Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-36ceeb3b-d930-4848-a3ff-ad240bd2edff-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-36ceeb3b-d930-4848-a3ff-ad240bd2edff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-36ceeb3b-d930-4848-a3ff-ad240bd2edff" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-36ceeb3b-d930-4848-a3ff-ad240bd2edff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Deleting offline snapshot 36ceeb3b-d930-4848-a3ff-ad240bd2edff of volume 95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] snapshot_file for this snap is: volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a14a848-8fef-484f-a6db-ffb9a1c71643]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:39 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff Sep 06 23:07:39 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:39 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d 1073741824" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:39 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d Sep 06 23:07:39 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:39 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95bba4d3-5b97-4df7-bb1a-78819422becc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf8a1ad-260d-48df-9671-876d9644a51a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:39 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe0024-30b9-4653-b948-c259bb9e52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6457664-b9f0-4786-a3d4-5ae7a084c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Volume volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d (6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d): created successfully Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6457664-b9f0-4786-a3d4-5ae7a084c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (708cae03-6d0e-4a8d-ac36-2a1a204c99ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:39 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc Sep 06 23:07:39 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-11b245c5-c0fa-4b86-8c79-5d2e1eb6e6de tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:40 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:40 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff Sep 06 23:07:40 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:40 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:40 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff Sep 06 23:07:40 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:40 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc.36ceeb3b-d930-4848-a3ff-ad240bd2edff" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-36ceeb3b-d930-4848-a3ff-ad240bd2edff" released by "_delete_snapshot" :: held 1.398s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" released by "delete_snapshot" :: held 1.421s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Created reservations ['582dfd40-4605-43f4-8ee7-66309576a0d6', '3418d737-496c-4966-bea2-314ca8dd773b', '3a607f89-643d-461b-8053-d1232f31d768', '645c5f7d-c105-4203-a8c8-b82b6495be8b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Delete snapshot completed successfully. Sep 06 23:07:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6301d539-e9cf-4c23-bfca-3661e994d007 tempest-ProjectReaderTests-676931063 None] Lock "cinder-36ceeb3b-d930-4848-a3ff-ad240bd2edff-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 of volume 6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ecfe6-7a4a-4967-8e66-bb25d96ea706]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:41 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d Sep 06 23:07:41 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-95bba4d3-5b97-4df7-bb1a-78819422becc-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "cinder-95bba4d3-5b97-4df7-bb1a-78819422becc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:41 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:41 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 1G Sep 06 23:07:41 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a2ca78-c1fc-4ffb-84c1-4f8b394a20df]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:41 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc Sep 06 23:07:41 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:41 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 1G" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:41 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 Sep 06 23:07:41 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:41 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:41 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc Sep 06 23:07:41 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:42 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 is being set with open permissions: ugo+rw Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:42 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 Sep 06 23:07:42 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:42 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-95bba4d3-5b97-4df7-bb1a-78819422becc" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-95bba4d3-5b97-4df7-bb1a-78819422becc" released by "delete_volume" :: held 0.697s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Created reservations ['6b4047be-abae-4780-b340-0b276de9a1c0', '5d7160a9-3e9c-4472-bd1a-6aab93a0c065', '05fcef77-65bc-49bc-bb59-b1d8d2bee34e', 'a443a264-b62e-422d-8938-8d6dc0a62a08'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:42 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:42 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:42 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:42 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info Sep 06 23:07:42 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:42 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Deleted volume successfully. Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a96d2938-d4e9-495d-9c5d-b3430252f606 tempest-ProjectReaderTests-676931063 None] Lock "cinder-95bba4d3-5b97-4df7-bb1a-78819422becc-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:42 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info is being set with open permissions: ugo+rw Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:42 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info Sep 06 23:07:42 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:42 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.info" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (a95f045b-a66f-402a-8b9b-150794297795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc110cca-bac7-45f4-90ec-1c166fd609dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d054ffbf-f66f-4936-9c08-63332b954d37 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc110cca-bac7-45f4-90ec-1c166fd609dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840434938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:43Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27255833-27d7-4870-9b32-556108ef0f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27255833-27d7-4870-9b32-556108ef0f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4896adab-f5b2-4ee0-ab54-d38d3086a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4896adab-f5b2-4ee0-ab54-d38d3086a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dd5fe4-3f2e-457a-8915-e2e56f1d27b6', 'volume_name': 'volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e25badb-ba65-4952-871e-92bac2cfd509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e25badb-ba65-4952-871e-92bac2cfd509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e88c3e1-77df-4f15-b295-7da720e3c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Volume d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6', 'volume_size': 1} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840434938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1041e78520b44e387762729d5aecefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:43Z,use_quota=True,user_id='1730612b901342bdadabdc0ddc3ddcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Creating volume d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:43 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:43 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 1073741824 Sep 06 23:07:43 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:43 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 1073741824" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:43 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 Sep 06 23:07:43 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:43 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e88c3e1-77df-4f15-b295-7da720e3c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db568e6b-a2a7-4004-be4d-d803d59179a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Volume volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 (d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6): created successfully Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db568e6b-a2a7-4004-be4d-d803d59179a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Flow 'volume_create_manager' (a95f045b-a66f-402a-8b9b-150794297795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6e791cb3-7235-4386-9a96-04bc96e8326c tempest-ProjectReaderTests-676931063 None] Created volume successfully. Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Creating offline snapshot 49746cb9-d1da-40bd-90c4-bac2eef5c763 of volume d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1c5574-b0d0-4bcf-992c-798614801f2d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 of volume 6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[69763065-9776-4a80-83a4-31049856787f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:44 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 Sep 06 23:07:44 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:44 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 Sep 06 23:07:44 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:44 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:44 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 1G Sep 06 23:07:44 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:44 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" returned: 0 in 0.385s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d025b-a8db-4ff2-a7ad-23cb895727d2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:44 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d Sep 06 23:07:44 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:44 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 1G" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:44 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 Sep 06 23:07:44 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:45 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:45 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 Sep 06 23:07:45 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:45 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 is being set with open permissions: ugo+rw Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:45 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 Sep 06 23:07:45 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:45 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:45 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74 Sep 06 23:07:45 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:45 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:45 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info Sep 06 23:07:45 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:45 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d.e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74" released by "_delete_snapshot" :: held 1.434s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" released by "delete_snapshot" :: held 1.457s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Created reservations ['cb28d8cd-a495-4906-8ddd-932b6fa9435c', 'f520b83f-4455-4425-a113-7894f29e6504', 'e4da5086-6933-4c1d-b7e8-d737960d66be', '9164d437-b459-4231-9536-3b6e74d40927'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:45 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:45 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info is being set with open permissions: ugo+rw Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d21fc8c-af30-4c95-a205-214e03d28499 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-e4ec30aa-4ad9-4d6a-ba1a-e3440eb95f74-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:45 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info Sep 06 23:07:45 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:46 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.info" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5da66fbe-e445-4751-811d-48634e5a7c76 tempest-ProjectReaderTests-676931063 None] Create snapshot completed successfully Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-49746cb9-d1da-40bd-90c4-bac2eef5c763-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-49746cb9-d1da-40bd-90c4-bac2eef5c763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-49746cb9-d1da-40bd-90c4-bac2eef5c763" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-49746cb9-d1da-40bd-90c4-bac2eef5c763" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Deleting offline snapshot 49746cb9-d1da-40bd-90c4-bac2eef5c763 of volume d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] snapshot_file for this snap is: volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df86e54-69d1-410a-801b-fc5eb04e8782]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[30062abe-f2f4-4a7c-b947-f566ecacbc1f]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:46 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 Sep 06 23:07:46 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:46 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d Sep 06 23:07:46 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:46 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[763459d7-f668-4aa9-bfa2-1ba4bfa51eb5]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:46 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:46 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 Sep 06 23:07:46 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:46 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d Sep 06 23:07:46 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:47 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d" released by "delete_volume" :: held 0.682s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:47 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:47 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 Sep 06 23:07:47 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Created reservations ['354882d4-469c-457b-b1ff-5e60d7981037', '1b8a2488-4e06-4665-bd5e-37a2801d2a74', '6d5d00c4-da42-434a-a7a6-16c10fe588c8', 'ceb813df-8b55-42bf-8905-e0a527be634b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:47 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:47 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:47 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:47 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:47 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763 Sep 06 23:07:47 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4f54344c-1b2d-4b2f-b4c3-b1350e7bc5e1 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-6ec2ce87-3ddd-4dda-81c0-76cb25c54e5d-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:47 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6.49746cb9-d1da-40bd-90c4-bac2eef5c763" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-49746cb9-d1da-40bd-90c4-bac2eef5c763" released by "_delete_snapshot" :: held 1.526s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" released by "delete_snapshot" :: held 1.557s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Created reservations ['56c7e514-adec-42b7-a681-64544e627ee3', '6c8f8a1e-c87e-44fb-a2dd-d7633345de66', '80b05ac9-8000-4581-9e4b-86879d06546c', 'fab4b3fd-4f7d-4f72-81a3-b06da636e01c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Delete snapshot completed successfully. Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (17d751d6-927b-467b-a94b-1b0731f07db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81cc0e4-e3ed-4065-a685-b2d89fe2b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fec6c1a0-4f49-4bd3-9f3a-68ce2631638b tempest-ProjectReaderTests-676931063 None] Lock "cinder-49746cb9-d1da-40bd-90c4-bac2eef5c763-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81cc0e4-e3ed-4065-a685-b2d89fe2b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319834084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844e246e-86bf-410e-80c0-32d809ba96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:48Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe826b6-652b-4a10-9e7e-b8b3711f245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe826b6-652b-4a10-9e7e-b8b3711f245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c770c5-ae8c-4c25-ad90-b2b301c98322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c770c5-ae8c-4c25-ad90-b2b301c98322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844e246e-86bf-410e-80c0-32d809ba96bb', 'volume_name': 'volume-844e246e-86bf-410e-80c0-32d809ba96bb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d108f1-52f2-449e-b12b-b4480cb01029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d108f1-52f2-449e-b12b-b4480cb01029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c30f-57cb-4c2d-9bfb-10ac47b90942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Volume 844e246e-86bf-410e-80c0-32d809ba96bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844e246e-86bf-410e-80c0-32d809ba96bb', 'volume_size': 1} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319834084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844e246e-86bf-410e-80c0-32d809ba96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:48Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Creating volume 844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:48 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:48 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb 1073741824 Sep 06 23:07:48 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "cinder-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Acquiring lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:48 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb 1073741824" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6042c94c-a063-4a15-84d8-477cdaccb26a]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:48 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb Sep 06 23:07:48 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:48 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 Sep 06 23:07:48 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:48 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c30f-57cb-4c2d-9bfb-10ac47b90942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844e246e-86bf-410e-80c0-32d809ba96bb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f828112-989b-4013-9f60-2e4adbb25cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Volume volume-844e246e-86bf-410e-80c0-32d809ba96bb (844e246e-86bf-410e-80c0-32d809ba96bb): created successfully Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f828112-989b-4013-9f60-2e4adbb25cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (17d751d6-927b-467b-a94b-1b0731f07db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:48 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-49a1936b-139b-4ea7-a2f0-a6c4533d7df4 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:48 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6 Sep 06 23:07:48 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:49 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "cinder-quobyte-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6" released by "delete_volume" :: held 0.683s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot 52d29f85-3162-4209-9c7d-9e0471a8e157 of volume 844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[180df530-f2b2-4a37-ad63-d8121e6013fa]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Created reservations ['4f7c5eff-14ce-4960-8d0a-3ece9167c78d', 'ff3d169d-27e6-4a34-a3e3-01d6b6fbe727', 'a761cca8-26b8-4e52-a6f7-5cfe69957acc', 'd8b4038b-f6f6-4d5d-9349-df367d445704'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:49 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb Sep 06 23:07:49 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:49 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:49 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:49 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Deleted volume successfully. Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eadf76b3-1d27-4bd1-8888-728a730bbec4 tempest-ProjectReaderTests-676931063 None] Lock "cinder-d3dd5fe4-3f2e-457a-8915-e2e56f1d27b6-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:49 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:49 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 1G Sep 06 23:07:49 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:50 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 1G" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844e246e-86bf-410e-80c0-32d809ba96bb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:50 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844e246e-86bf-410e-80c0-32d809ba96bb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 Sep 06 23:07:50 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:50 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844e246e-86bf-410e-80c0-32d809ba96bb -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:50 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 is being set with open permissions: ugo+rw Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:50 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 Sep 06 23:07:50 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:50 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:50 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info Sep 06 23:07:50 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:51 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info is being set with open permissions: ugo+rw Sep 06 23:07:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:51 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info Sep 06 23:07:51 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:51 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-dedb5479-7775-49b7-a38e-c4c4a9529cc0 tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-52d29f85-3162-4209-9c7d-9e0471a8e157-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-52d29f85-3162-4209-9c7d-9e0471a8e157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-52d29f85-3162-4209-9c7d-9e0471a8e157" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-52d29f85-3162-4209-9c7d-9e0471a8e157" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot 52d29f85-3162-4209-9c7d-9e0471a8e157 of volume 844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6e1f4-2561-409d-bbde-4452e88d69f9]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:52 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 Sep 06 23:07:52 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:52 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844e246e-86bf-410e-80c0-32d809ba96bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[35475eb5-5efe-4865-bec4-84986b4ab05e]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:53 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb Sep 06 23:07:53 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:53 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb" returned: 0 in 0.403s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:53 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 Sep 06 23:07:53 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:53 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:53 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157 Sep 06 23:07:53 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:53 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb.52d29f85-3162-4209-9c7d-9e0471a8e157" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-52d29f85-3162-4209-9c7d-9e0471a8e157" released by "_delete_snapshot" :: held 1.445s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" released by "delete_snapshot" :: held 1.467s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Created reservations ['e0e10565-dc76-4613-a3bc-2f3a969fae90', 'ec9e89e4-8770-4d4b-a982-095e009817bb', '9d79cf1d-e73f-4b2b-8dfb-c78e9f18a646', '5f467f23-3426-4302-a6ea-64e63b51c500'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96e7b075-6ede-4a5f-b241-b6aec81ac8d4 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-52d29f85-3162-4209-9c7d-9e0471a8e157-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-844e246e-86bf-410e-80c0-32d809ba96bb-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-844e246e-86bf-410e-80c0-32d809ba96bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae8dc4-5d07-4b48-af30-4a9d6f378e9b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:54 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb Sep 06 23:07:54 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:55 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:55 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb Sep 06 23:07:55 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:55 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-844e246e-86bf-410e-80c0-32d809ba96bb" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-844e246e-86bf-410e-80c0-32d809ba96bb" released by "delete_volume" :: held 0.726s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Created reservations ['6a68cdbe-d654-4bea-bcbc-a7abd1ffb58e', 'ff612c95-612c-4068-b9a1-948d3c6ea04c', 'df2db820-515d-47f7-a36b-87a0336827de', '6d8e9efc-a14f-4793-b72f-0d23f782d7b7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:55 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:07:55 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:55 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:07:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:07:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2985d687-bd2e-4c0a-a6e8-b832139a656b tempest-ProjectMemberTests-1186030494 None] Lock "cinder-844e246e-86bf-410e-80c0-32d809ba96bb-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (1b5fb27c-2053-4dd8-9c14-301b6e968d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c02ce7-9e61-4b9b-9ca4-5a788fe4aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c02ce7-9e61-4b9b-9ca4-5a788fe4aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632816717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c4371-a072-4521-8add-ccd383bb02f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:56Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbf075a-c6e4-4a7d-8372-b77b01f7c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbf075a-c6e4-4a7d-8372-b77b01f7c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d6f1a1-a28c-4637-aac6-f05c5d880116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d6f1a1-a28c-4637-aac6-f05c5d880116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5c4371-a072-4521-8add-ccd383bb02f6', 'volume_name': 'volume-1e5c4371-a072-4521-8add-ccd383bb02f6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a77d6bb-8856-4aa9-8f6f-1f0a0b878813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a77d6bb-8856-4aa9-8f6f-1f0a0b878813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e6c87c-9658-4656-ada4-f9c46cbeebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Volume 1e5c4371-a072-4521-8add-ccd383bb02f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5c4371-a072-4521-8add-ccd383bb02f6', 'volume_size': 1} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632816717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c4371-a072-4521-8add-ccd383bb02f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4266b1794f41e0915cd24249a89f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:07:56Z,use_quota=True,user_id='0c69c85dbb584b2985d9b3c031b3561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Creating volume 1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:07:56 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:56 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 1073741824 Sep 06 23:07:56 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:56 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 1073741824" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:56 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 Sep 06 23:07:56 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:57 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e6c87c-9658-4656-ada4-f9c46cbeebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5c4371-a072-4521-8add-ccd383bb02f6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95237c3-1653-4d50-930d-00703d4d1278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:07:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Volume volume-1e5c4371-a072-4521-8add-ccd383bb02f6 (1e5c4371-a072-4521-8add-ccd383bb02f6): created successfully Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95237c3-1653-4d50-930d-00703d4d1278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Flow 'volume_create_manager' (1b5fb27c-2053-4dd8-9c14-301b6e968d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:07:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-034ae12e-893b-4c05-9dc8-f0c00ff05ce9 tempest-ProjectMemberTests-1186030494 None] Created volume successfully. Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Creating offline snapshot 37cb6a6a-d210-4540-8503-4800c7c089f6 of volume 1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff102f6-f943-42b2-bb85-dec3ccaf3a09]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:57 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 Sep 06 23:07:57 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:57 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:57 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 1G Sep 06 23:07:57 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:58 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 1G" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5c4371-a072-4521-8add-ccd383bb02f6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:58 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5c4371-a072-4521-8add-ccd383bb02f6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 Sep 06 23:07:58 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:58 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5c4371-a072-4521-8add-ccd383bb02f6 -F qcow2 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:58 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 is being set with open permissions: ugo+rw Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:58 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 Sep 06 23:07:58 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:58 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:58 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info Sep 06 23:07:58 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:59 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info is being set with open permissions: ugo+rw Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:59 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info Sep 06 23:07:59 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:07:59 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.info" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:07:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-24863306-60f7-49b4-931a-701b754b392b tempest-ProjectMemberTests-1186030494 None] Create snapshot completed successfully Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-37cb6a6a-d210-4540-8503-4800c7c089f6-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-37cb6a6a-d210-4540-8503-4800c7c089f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-37cb6a6a-d210-4540-8503-4800c7c089f6" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-37cb6a6a-d210-4540-8503-4800c7c089f6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Deleting offline snapshot 37cb6a6a-d210-4540-8503-4800c7c089f6 of volume 1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] snapshot_file for this snap is: volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20d9e6-c3c5-4861-9b71-6cea1d008d47]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:07:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:07:59 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 Sep 06 23:07:59 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:00 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5c4371-a072-4521-8add-ccd383bb02f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43165a-54a6-4078-bb49-d8660d4348e8]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:00 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 Sep 06 23:08:00 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:00 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:00 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 Sep 06 23:08:00 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:00 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:00 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6 Sep 06 23:08:00 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:01 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6.37cb6a6a-d210-4540-8503-4800c7c089f6" returned: 0 in 0.239s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-37cb6a6a-d210-4540-8503-4800c7c089f6" released by "_delete_snapshot" :: held 1.412s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" released by "delete_snapshot" :: held 1.434s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Created reservations ['4e5ee2d4-83a7-4de2-880c-8766045fa476', '3d3b7cc5-b119-4cd0-8035-8264dbbdda86', '1ef811e0-e740-40cd-9fbc-0e9b194abf98', '75994838-54ef-4d5d-90d8-c510954affe3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Delete snapshot completed successfully. Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0288697-3d29-4cd5-bdb1-fced192de718 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-37cb6a6a-d210-4540-8503-4800c7c089f6-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-1e5c4371-a072-4521-8add-ccd383bb02f6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-1e5c4371-a072-4521-8add-ccd383bb02f6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7187c37a-a427-400e-a69b-a3664256aa2d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:02 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 Sep 06 23:08:02 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:02 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:02 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6 Sep 06 23:08:02 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:02 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-1e5c4371-a072-4521-8add-ccd383bb02f6" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-quobyte-1e5c4371-a072-4521-8add-ccd383bb02f6" released by "delete_volume" :: held 0.648s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Created reservations ['395a5fe1-773b-4cfb-adfe-9528716a3bd2', '148cf57c-ef56-43f8-b6c3-48fb7b9e12f4', '0d68e20c-d9fc-4df6-afaf-f8926a6aa72c', '036281d8-b815-4b1c-9293-38603bd2f243'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:02 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:02 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:02 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Deleted volume successfully. Sep 06 23:08:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-24ba5efd-15f2-4855-9fc4-ad1611b53bd2 tempest-ProjectMemberTests-1186030494 None] Lock "cinder-1e5c4371-a072-4521-8add-ccd383bb02f6-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:05 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:05 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:05 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread count: 29 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 23:08:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55b1fde2-363a-4dae-a432-b0322e49aea6 None None] thread info: [<_MainThread(MainThread, started 135530692214912)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 23:08:12 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=86,cinder:DELETE=6,cinder:SELECT=64,cinder:INSERT=27 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:08:12 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=71,cinder:UPDATE=86,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (efc400c2-1905-4828-a20e-1abfeba53101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ca831-0925-48fd-8f83-5d2049b1c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ca831-0925-48fd-8f83-5d2049b1c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4422771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f503c215-2b10-48c9-9406-8fa4ce35592d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:20Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e0dd1c-3a66-4707-973e-b44eab8b323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e0dd1c-3a66-4707-973e-b44eab8b323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2c090d-c489-4a37-a926-1517dce36ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2c090d-c489-4a37-a926-1517dce36ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f503c215-2b10-48c9-9406-8fa4ce35592d', 'volume_name': 'volume-f503c215-2b10-48c9-9406-8fa4ce35592d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc650610-a580-43e5-a311-f7fb92bed950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc650610-a580-43e5-a311-f7fb92bed950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef7f410-e70a-4669-9f0a-4f3569202762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Volume f503c215-2b10-48c9-9406-8fa4ce35592d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f503c215-2b10-48c9-9406-8fa4ce35592d', 'volume_size': 1} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4422771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f503c215-2b10-48c9-9406-8fa4ce35592d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:20Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Creating volume f503c215-2b10-48c9-9406-8fa4ce35592d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:08:20 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:20 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d 1073741824 Sep 06 23:08:20 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:20 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d 1073741824" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:20 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d Sep 06 23:08:20 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:21 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef7f410-e70a-4669-9f0a-4f3569202762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f503c215-2b10-48c9-9406-8fa4ce35592d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cc26b1-945e-44a2-a8d0-0fc760e52b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Volume volume-f503c215-2b10-48c9-9406-8fa4ce35592d (f503c215-2b10-48c9-9406-8fa4ce35592d): created successfully Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cc26b1-945e-44a2-a8d0-0fc760e52b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (efc400c2-1905-4828-a20e-1abfeba53101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1f69fd7a-2c14-4433-a9c3-31eda8163a0f tempest-ProjectReaderTests-1252607856 None] Created volume successfully. Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-f503c215-2b10-48c9-9406-8fa4ce35592d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "cinder-f503c215-2b10-48c9-9406-8fa4ce35592d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-quobyte-f503c215-2b10-48c9-9406-8fa4ce35592d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-f503c215-2b10-48c9-9406-8fa4ce35592d" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c677db0-0bae-4fba-8a61-10da219fcaa6]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:21 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d Sep 06 23:08:21 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:21 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:22 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d Sep 06 23:08:22 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:22 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-f503c215-2b10-48c9-9406-8fa4ce35592d" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-f503c215-2b10-48c9-9406-8fa4ce35592d" released by "delete_volume" :: held 0.609s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Created reservations ['26c8fc22-91d9-45f6-9207-3c8a1ea9445b', 'e1778ada-7c68-4bfc-8cb0-6f3950d29ad6', 'c6e648ca-7275-4c17-962a-cfa193bfee46', 'a669d830-0de8-47ba-877a-ca2d6524db3f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:22 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:22 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:22 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Deleted volume successfully. Sep 06 23:08:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9a9dd400-f1ad-4352-a7f7-75df57544f7e tempest-ProjectReaderTests-1252607856 None] Lock "cinder-f503c215-2b10-48c9-9406-8fa4ce35592d-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (c63ad203-0fae-4425-b1a0-54a1ff4b0c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e78cb-f2af-4c4c-bd00-0d9a50df525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e78cb-f2af-4c4c-bd00-0d9a50df525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013857875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b3b46d-bcdf-4298-90d6-0317aeadf1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:23Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24c985a-7e78-4e3d-a478-44c638220736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24c985a-7e78-4e3d-a478-44c638220736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a638d7e2-759e-448b-ad26-d2c65e20cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a638d7e2-759e-448b-ad26-d2c65e20cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b3b46d-bcdf-4298-90d6-0317aeadf1df', 'volume_name': 'volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad314d3f-25ec-4f9e-b68d-5cb1d8e7d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad314d3f-25ec-4f9e-b68d-5cb1d8e7d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1915780-dda2-40d1-9b92-66806b433b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Volume 64b3b46d-bcdf-4298-90d6-0317aeadf1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df', 'volume_size': 1} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013857875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b3b46d-bcdf-4298-90d6-0317aeadf1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:23Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Creating volume 64b3b46d-bcdf-4298-90d6-0317aeadf1df {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:08:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:23 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df 1073741824 Sep 06 23:08:23 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:23 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df 1073741824" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:23 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df Sep 06 23:08:23 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:23 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1915780-dda2-40d1-9b92-66806b433b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d5bdd8-61f4-4b1e-92fe-55138144e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Volume volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df (64b3b46d-bcdf-4298-90d6-0317aeadf1df): created successfully Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d5bdd8-61f4-4b1e-92fe-55138144e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (c63ad203-0fae-4425-b1a0-54a1ff4b0c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7007cfdb-459a-4b4f-a99b-e23ecd81fab1 tempest-ProjectReaderTests-1252607856 None] Created volume successfully. Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-64b3b46d-bcdf-4298-90d6-0317aeadf1df-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-64b3b46d-bcdf-4298-90d6-0317aeadf1df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-quobyte-64b3b46d-bcdf-4298-90d6-0317aeadf1df" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-64b3b46d-bcdf-4298-90d6-0317aeadf1df" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7677697-5e3b-43e3-9d2a-493078997ef2]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:24 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df Sep 06 23:08:24 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:24 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:24 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df Sep 06 23:08:24 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:24 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-64b3b46d-bcdf-4298-90d6-0317aeadf1df" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-64b3b46d-bcdf-4298-90d6-0317aeadf1df" released by "delete_volume" :: held 0.615s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Created reservations ['dc40efd4-baff-47ff-a7f6-7a12f989f6d6', 'c2e860f8-0a47-48c6-b221-54d8414d1324', 'fe7dd425-010d-4105-aa01-1ab9f1f802d3', '012665f7-da00-44b2-a468-e1f09ba35b22'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:25 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:25 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:25 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Deleted volume successfully. Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40001f51-8388-480c-b300-b52a56089246 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-64b3b46d-bcdf-4298-90d6-0317aeadf1df-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (edbf92c9-ac60-435e-a30c-827f351f173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8147a8-1256-4bb9-8e96-0745e528be93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8147a8-1256-4bb9-8e96-0745e528be93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932587347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3807dd8-10d0-4687-b642-6cf06bf323b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:26Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde6a603-b2b0-4b25-8601-08065f92ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde6a603-b2b0-4b25-8601-08065f92ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edaadb9-f1d9-4470-ac7d-b7d703bbcccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edaadb9-f1d9-4470-ac7d-b7d703bbcccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3807dd8-10d0-4687-b642-6cf06bf323b4', 'volume_name': 'volume-b3807dd8-10d0-4687-b642-6cf06bf323b4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035430a-6cf7-4606-9852-04523b6f79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035430a-6cf7-4606-9852-04523b6f79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51394ef-e1f0-4d20-b5ff-6a7a2c38170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Volume b3807dd8-10d0-4687-b642-6cf06bf323b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3807dd8-10d0-4687-b642-6cf06bf323b4', 'volume_size': 1} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932587347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3807dd8-10d0-4687-b642-6cf06bf323b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:26Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Creating volume b3807dd8-10d0-4687-b642-6cf06bf323b4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:08:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:08:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:25 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 1073741824 Sep 06 23:08:25 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:26 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 1073741824" returned: 0 in 0.429s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:26 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 Sep 06 23:08:26 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:26 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51394ef-e1f0-4d20-b5ff-6a7a2c38170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3807dd8-10d0-4687-b642-6cf06bf323b4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6a2165-505b-4258-8f8e-79b7287f2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Volume volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 (b3807dd8-10d0-4687-b642-6cf06bf323b4): created successfully Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6a2165-505b-4258-8f8e-79b7287f2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (edbf92c9-ac60-435e-a30c-827f351f173a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5e1fd923-c2f8-4c35-a3c9-337df8984f3b tempest-ProjectReaderTests-1252607856 None] Created volume successfully. Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-b3807dd8-10d0-4687-b642-6cf06bf323b4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "cinder-b3807dd8-10d0-4687-b642-6cf06bf323b4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-quobyte-b3807dd8-10d0-4687-b642-6cf06bf323b4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-b3807dd8-10d0-4687-b642-6cf06bf323b4" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1caf7c-71ca-4572-b4c5-cee2c116f46d]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:27 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 Sep 06 23:08:27 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:27 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:27 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4 Sep 06 23:08:27 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:27 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-b3807dd8-10d0-4687-b642-6cf06bf323b4" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-b3807dd8-10d0-4687-b642-6cf06bf323b4" released by "delete_volume" :: held 0.628s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Created reservations ['7e7ac217-7d8b-4cdc-bc28-199b7597478d', 'a3eff863-b00d-43b7-b583-d1dde17ce8e1', 'edf5b16a-e631-4152-9e26-26b2b96e0f6c', 'be738bef-785a-4f4f-ab8c-e8a3f07cd297'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:27 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:27 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:27 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Deleted volume successfully. Sep 06 23:08:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-51ac8f70-a9c0-4468-a347-99f9cf8caafc tempest-ProjectReaderTests-1252607856 None] Lock "cinder-b3807dd8-10d0-4687-b642-6cf06bf323b4-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (7242e115-e4d3-4a25-ac8e-fcf4791c9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ba1623-dcb1-4470-b190-75510b383c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ba1623-dcb1-4470-b190-75510b383c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924019117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8898e537-dd4a-4d1e-9428-35c6282848ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:28Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5af1b5-b06b-4910-a520-9f021a03d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5af1b5-b06b-4910-a520-9f021a03d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574cbe9d-b3be-4aa6-bf44-369b7bad684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574cbe9d-b3be-4aa6-bf44-369b7bad684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8898e537-dd4a-4d1e-9428-35c6282848ce', 'volume_name': 'volume-8898e537-dd4a-4d1e-9428-35c6282848ce', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95c584a-8443-42ba-ba10-f836d56e29f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95c584a-8443-42ba-ba10-f836d56e29f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eac1b37-8d52-4181-9b7d-0a4380e081cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Volume 8898e537-dd4a-4d1e-9428-35c6282848ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8898e537-dd4a-4d1e-9428-35c6282848ce', 'volume_size': 1} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T21:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924019117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8898e537-dd4a-4d1e-9428-35c6282848ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61f5b4ab78c4b88937752282f5a844d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T21:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T21:08:28Z,use_quota=True,user_id='271fdd0526fe4965b58500590383c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ffb410a-6e03-4641-a554-82566b5a064d),volume_type_id=4ffb410a-6e03-4641-a554-82566b5a064d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Creating volume 8898e537-dd4a-4d1e-9428-35c6282848ce {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Selected osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 23:08:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] casted to osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05 Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:28 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce 1073741824 Sep 06 23:08:28 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:28 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce 1073741824" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:28 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce Sep 06 23:08:28 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:29 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eac1b37-8d52-4181-9b7d-0a4380e081cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8898e537-dd4a-4d1e-9428-35c6282848ce', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e1f4ed-022a-4020-bc49-3b10e0dda76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 23:08:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Volume volume-8898e537-dd4a-4d1e-9428-35c6282848ce (8898e537-dd4a-4d1e-9428-35c6282848ce): created successfully Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e1f4ed-022a-4020-bc49-3b10e0dda76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Flow 'volume_create_manager' (7242e115-e4d3-4a25-ac8e-fcf4791c9e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 23:08:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-53c6ee22-6339-4c34-b229-442b3c6ff668 tempest-ProjectReaderTests-1252607856 None] Created volume successfully. Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-8898e537-dd4a-4d1e-9428-35c6282848ce-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-8898e537-dd4a-4d1e-9428-35c6282848ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "cinder-quobyte-8898e537-dd4a-4d1e-9428-35c6282848ce" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-8898e537-dd4a-4d1e-9428-35c6282848ce" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f8ce13-8b97-4977-a213-904029190f9b]: (4, 'qcow2') {{(pid=89159) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:29 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce Sep 06 23:08:29 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:29 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:29 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce Sep 06 23:08:29 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:30 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99/volume-8898e537-dd4a-4d1e-9428-35c6282848ce" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-quobyte-8898e537-dd4a-4d1e-9428-35c6282848ce" released by "delete_volume" :: held 0.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Created reservations ['a656aaea-e227-42fd-a2f4-e2a43c85a390', '238cf446-9522-4bee-a991-425e75aace8e', '927fe25f-0478-4d2c-904c-c9247042b01c', '0f762cfe-1ab9-42d6-b71b-dc6c9b52e1fb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-745b070e-8197-4664-ad67-4382cd2a6e05'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 23:08:30 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99 Sep 06 23:08:30 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 23:08:30 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc657a74c65372104421ce82d1086f99" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 23:08:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Deleted volume successfully. Sep 06 23:08:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3bb1579-e685-4d45-a2ec-6dd6c0d770b0 tempest-ProjectReaderTests-1252607856 None] Lock "cinder-8898e537-dd4a-4d1e-9428-35c6282848ce-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 23:08:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 23:08:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=45,cinder:SELECT=23,cinder:DELETE=7,cinder:INSERT=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}